2020-11-20T11:33:03.581 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-20T11:33:03.583 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290 --block --lock --description fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/iogen} --owner scheduled_pdonnell@teuthology --verbose --name pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi -- /tmp/teuthology-worker.9pmgwnwb.tmp 2020-11-20T11:33:03.663 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:33:03.737 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290 branch: wip-pdonnell-testing-20201120.053228 description: fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/iogen} email: pdonnell@redhat.com first_in_suite: false job_id: '5640290' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.3' overrides: admin_socket: branch: wip-pdonnell-testing-20201120.053228 ceph: cephfs: session_timeout: 300 cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20201120.053228 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb owner: scheduled_pdonnell@teuthology priority: 95 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - osd.2 - osd.5 - osd.8 - osd.11 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb sleep_before_teardown: 0 suite: fs suite_branch: wip-pdonnell-testing-20201120.053228 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - workunit: clients: all: - suites/iogen.sh teuthology_branch: master timestamp: 2020-11-20_08:39:42 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.6036 2020-11-20T11:33:03.740 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa; will attempt to use it 2020-11-20T11:33:03.741 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa/tasks 2020-11-20T11:33:03.742 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-11-20T11:33:03.747 INFO:teuthology.task.internal:Checking packages... 2020-11-20T11:33:03.775 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash 'b86e691bf191566922a8f08e2a5abf64fde8cfcb' 2020-11-20T11:33:03.776 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-20T11:33:03.776 INFO:teuthology.packaging:ref: None 2020-11-20T11:33:03.777 INFO:teuthology.packaging:tag: None 2020-11-20T11:33:03.777 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20201120.053228 2020-11-20T11:33:03.777 INFO:teuthology.packaging:sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:33:03.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20201120.053228 2020-11-20T11:33:04.009 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-7397.gb86e691b 2020-11-20T11:33:04.010 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-11-20T11:33:04.027 INFO:teuthology.task.internal:no buildpackages task found 2020-11-20T11:33:04.028 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-20T11:33:04.064 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-20T11:33:04.065 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:33:04.128 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:33:14.145 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:33:24.161 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:33:34.178 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:33:44.200 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:33:54.401 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:34:04.419 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:34:14.436 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:34:24.453 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:34:34.479 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:34:44.498 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:34:54.515 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:04.534 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:14.550 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:24.576 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:34.593 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:44.604 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:54.632 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:36:04.652 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:36:14.675 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:36:24.693 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:36:34.712 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:36:44.731 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:36:54.747 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:37:04.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:37:14.779 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:37:24.790 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:37:34.805 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:37:44.823 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:37:54.842 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:38:04.863 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:38:14.880 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:38:24.911 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:38:34.929 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:38:44.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:38:54.961 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 3, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290'} 2020-11-20T11:38:54.983 DEBUG:teuthology.lock.ops:locked ubuntu@smithi164.front.sepia.ceph.com, ubuntu@smithi036.front.sepia.ceph.com, ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T11:38:55.062 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc584770ea0>, signals=[15]) 2020-11-20T11:38:55.276 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of rhel 8.3 2020-11-20T11:38:55.280 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of rhel 8.3 2020-11-20T11:38:55.282 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of rhel 8.3 2020-11-20T11:38:55.662 INFO:teuthology.orchestra.console:Power off smithi164 2020-11-20T11:38:55.663 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:38:55.682 INFO:teuthology.orchestra.console:Power off smithi036 2020-11-20T11:38:55.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:38:55.702 INFO:teuthology.orchestra.console:Power off smithi188 2020-11-20T11:38:55.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:38:55.714 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:38:55.723 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:38:55.738 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:38:59.757 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:38:59.771 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:38:59.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:03.869 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:03.882 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:03.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:04.104 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2020-11-20T11:39:04.206 INFO:teuthology.orchestra.console:Power on smithi188 2020-11-20T11:39:04.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:39:04.226 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:07.981 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:07.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:08.192 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2020-11-20T11:39:08.201 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2020-11-20T11:39:08.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:08.294 INFO:teuthology.orchestra.console:Power on smithi164 2020-11-20T11:39:08.295 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:39:08.303 INFO:teuthology.orchestra.console:Power on smithi036 2020-11-20T11:39:08.303 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:39:08.314 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:08.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:08.458 INFO:teuthology.orchestra.console:Power on for smithi188 completed 2020-11-20T11:39:08.559 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2020-11-20T11:39:12.339 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:12.348 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:16.450 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:16.459 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:39:16.669 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2020-11-20T11:39:16.743 INFO:teuthology.orchestra.console:Power on for smithi164 completed 2020-11-20T11:39:16.770 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2020-11-20T11:39:16.844 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2020-11-20T11:41:32.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:39.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:41.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:48.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:50.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:57.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:00.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:03.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:06.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:09.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:12.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:15.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:18.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:21.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:24.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:30.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:34.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:39.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:43.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:48.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:42:57.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:43:06.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:43:14.929 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:43:14.931 INFO:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:43:24.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:43:24.473 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:43:24.474 INFO:teuthology.orchestra.run.smithi036:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:43:24.773 INFO:teuthology.provision.fog.smithi036:Node is ready 2020-11-20T11:43:24.774 INFO:teuthology.orchestra.run.smithi036:> hostname 2020-11-20T11:43:24.788 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2020-11-20T11:43:24.789 INFO:teuthology.orchestra.run.smithi036:> grep smithi036.front.sepia.ceph.com /etc/hosts 2020-11-20T11:43:24.844 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2020-11-20T11:43:24.845 INFO:teuthology.orchestra.run.smithi036:> sudo hostname smithi036 2020-11-20T11:43:24.947 INFO:teuthology.orchestra.run.smithi036:> sudo sed -i -e 's/smithi036.front.sepia.ceph.com/smithi036/g' /etc/hosts 2020-11-20T11:43:24.974 INFO:teuthology.orchestra.run.smithi036:> sudo sed -i -e 's/172.21.15.36/172.21.15.36/g' /etc/hosts 2020-11-20T11:43:25.057 INFO:teuthology.orchestra.run.smithi036:> sudo sed -i -e 's/smithi036.front.sepia.ceph.com/smithi036/g' /etc/hostname 2020-11-20T11:43:25.154 INFO:teuthology.orchestra.run.smithi036:> sudo hostname smithi036 2020-11-20T11:43:25.231 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2020-11-20T11:43:25.232 DEBUG:teuthology.parallel:result is None 2020-11-20T11:43:35.184 INFO:teuthology.provision.fog.smithi188:Node is ready 2020-11-20T11:43:35.185 INFO:teuthology.orchestra.run.smithi188:> hostname 2020-11-20T11:43:35.205 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2020-11-20T11:43:35.206 INFO:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2020-11-20T11:43:35.273 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2020-11-20T11:43:35.274 INFO:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2020-11-20T11:43:35.458 INFO:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2020-11-20T11:43:35.493 INFO:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2020-11-20T11:43:35.563 INFO:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2020-11-20T11:43:35.632 INFO:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2020-11-20T11:43:35.697 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2020-11-20T11:43:35.698 DEBUG:teuthology.parallel:result is None 2020-11-20T11:43:38.300 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:43:38.301 INFO:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:43:58.462 INFO:teuthology.provision.fog.smithi164:Node is ready 2020-11-20T11:43:58.463 INFO:teuthology.orchestra.run.smithi164:> hostname 2020-11-20T11:43:58.489 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2020-11-20T11:43:58.490 INFO:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2020-11-20T11:43:58.552 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2020-11-20T11:43:58.553 INFO:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2020-11-20T11:43:58.705 INFO:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2020-11-20T11:43:58.736 INFO:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2020-11-20T11:43:58.805 INFO:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2020-11-20T11:43:58.874 INFO:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2020-11-20T11:43:58.940 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2020-11-20T11:43:58.941 DEBUG:teuthology.parallel:result is None 2020-11-20T11:43:59.082 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2020-11-20T11:43:59.082 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:43:59.099 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com 2020-11-20T11:43:59.099 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:43:59.111 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2020-11-20T11:43:59.112 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:43:59.126 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:43:59.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:43:59.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:43:59.192 INFO:teuthology.orchestra.run.smithi164:> true 2020-11-20T11:43:59.351 INFO:teuthology.orchestra.run.smithi164:> uname -m 2020-11-20T11:43:59.404 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2020-11-20T11:43:59.404 INFO:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2020-11-20T11:43:59.458 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:43:59.458 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:43:59.458 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2020-11-20T11:43:59.459 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2020-11-20T11:43:59.459 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.3" 2020-11-20T11:43:59.459 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:43:59.459 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:43:59.460 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2020-11-20T11:43:59.460 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:43:59.460 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:43:59.460 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:43:59.460 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:43:59.461 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:43:59.461 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:43:59.461 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:43:59.461 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:43:59.462 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2020-11-20T11:43:59.479 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:43:59.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:43:59.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:43:59.547 INFO:teuthology.orchestra.run.smithi036:> true 2020-11-20T11:43:59.716 INFO:teuthology.orchestra.run.smithi036:> uname -m 2020-11-20T11:43:59.770 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2020-11-20T11:43:59.771 INFO:teuthology.orchestra.run.smithi036:> cat /etc/os-release 2020-11-20T11:43:59.825 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:43:59.826 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:43:59.826 INFO:teuthology.orchestra.run.smithi036.stdout:ID="rhel" 2020-11-20T11:43:59.826 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE="fedora" 2020-11-20T11:43:59.826 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="8.3" 2020-11-20T11:43:59.827 INFO:teuthology.orchestra.run.smithi036.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:43:59.827 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:43:59.827 INFO:teuthology.orchestra.run.smithi036.stdout:ANSI_COLOR="0;31" 2020-11-20T11:43:59.827 INFO:teuthology.orchestra.run.smithi036.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:43:59.827 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:43:59.828 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:43:59.828 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:43:59.828 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:43:59.828 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:43:59.828 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:43:59.829 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:43:59.829 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2020-11-20T11:43:59.845 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:43:59.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:43:59.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:43:59.913 INFO:teuthology.orchestra.run.smithi188:> true 2020-11-20T11:44:00.083 INFO:teuthology.orchestra.run.smithi188:> uname -m 2020-11-20T11:44:00.141 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2020-11-20T11:44:00.142 INFO:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2020-11-20T11:44:00.196 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:44:00.196 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:44:00.196 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2020-11-20T11:44:00.197 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2020-11-20T11:44:00.197 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.3" 2020-11-20T11:44:00.197 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:44:00.197 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:44:00.197 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2020-11-20T11:44:00.198 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:44:00.198 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:44:00.198 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:44:00.198 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:44:00.198 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:44:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:44:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:44:00.199 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:44:00.200 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2020-11-20T11:44:00.215 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-11-20T11:44:00.262 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEqXMc96dndE8R4ZjUa16wC0s8WdO3+vNSClbZCLSZeJXjrKnvbbJFky6IP+TSNZ7OVtzKazeYHlIsobeFmnkEXOI0S5a0DbKgyCGnsCPBoWY0FD0FUCPTPqULQxMWww7d1/Tk1kODo5+0oJ4hefPBq8MDNzuyUayuN8SUeHhbvl2hwC0X59uQ5vRbgHy1LqFa2kzbM61QqedBhAnDKPE/09dVEfM+vtbh50X/EkDCmNcLqjosmGOxnNnst+2fFihnBhCKK10wlXBlcz8jmNweIfqZlEP5OjevrbUhA1WQQ+PR1hafs6VqdR8Bwlc35GsbMAIJoFENQwoqubkmLEz2u6ONty6a4VUYhMEkOnbVgGe91PZlSY+kjWbzhh279+l6LicZ6vjU7YhZXOcddJxqlsQ+bGX4Jkd2YQF57ufkBTSoiD1T11FfAjN3rn7xTDsOtGS9bIadlhcmbS7WhhnXvpSuzF8/j7c0SfRW+ii/2Ul57yTcoweOTwbbInKrRIM= smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxZnlEauJTFlRHPfCi3blevDcgdbQgA2KRj1db9LLxnm8O9zVI2MPatcqfab3nVkrt0Pddbcf619mx5IWrh3XQvfuR/6sw9f6a8O5cdgcwyYYGH/NediB7qbWbAgXgot8wNSy/lTyh6j0cpLWO5OePzJF7uhc9ZRkHKrHSgyEwUNzO/J6Wwvd62V09W42enZ1jEBD37UB7EXfO7oZmwImq2cijuX8LGZWvvhFSfBSwdVWxDTWNiuhYlHoH8XBNGiI6Tw+yGCAVHJq+XmHQDsx+WOLwE1vfNPFWB57cQmSnbKyDNINV3aIBQgiO+8f/hPlLffNh/7iiDEVfEJoMc5GPw9hE5pz4DJtRDBUGYxU55Rnl6qddkDin13T9roSjZ0xlIYd86kkIK+akfRkZJ1TdSkoLFgT6vc/T+dKLUnBGDNxYfFeSj7QMhu3O0C0md5jWrUTgJokAEULO5N0fd7TEn0FAgu22mH4rpp3XGXdzY7oBwYtXiQPd6xZUdBz4Kws= smithi188.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2mg53g+4UruO6CxZ5tNMLQrkafHZYs2F1S7U47UuDFUQVcRYZlV0uJYRxARZ7QsC9mPhnyDOMkfzPRscS5e2QRsNqdxTpK4XtRt6h6vCnquomrF4uFo0v+yTh75Y7N/4ft4bR6aK4G/CdB8RYq+xFAjjKSZvJO0DMxOwSaDMzttWfdoOCRia/+zehdsxajJ9G8RUg0sl/8ZKnRXq5zGOegDukxlJmzFPBlqBGBWwMHVegljoH/UFOtFaecjtgMycXRE/C73NbcLTNTOBDPRGggCLaV2hxtIYa0abZ/RdJ1Gi+8bQWQwGdP6XJFym1oNR6iHzZZoqBN29UJc1Cn1yU5zXw4sEUeIEVMwByNwaXcLkg/Yiyo/DDAa0jXD/pK2bhvcx6Z8DdyntJOt/tMyxTPxOR4OB0Dcm4QqtnvXNzmeO1NbcqhewH+nw7lmLN3Jy37YGYOaQ4+/NidPcpakcvDF1SflMgoyC3dgz7CdWPZiXEL2ehEBDamNWNF0eDwyk= 2020-11-20T11:44:00.262 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:44:00.322 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-20T11:44:00.330 INFO:teuthology.task.internal:Saving configuration 2020-11-20T11:44:00.363 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-20T11:44:00.491 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-20T11:44:00.508 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:38:54.966798', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFXprwxGrs94N6K5hm+2i4v6yXmymnbqLi82xOm94vdk2PX8PVBBSROHgDePMgqkOMek2ifGCOw4ZE4cigrBOWU=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi164.front.sepia.ceph.com'} 2020-11-20T11:44:00.524 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:38:54.966818', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTxSH2pFMZjWmgAvxLKdIU4aHSo/+1qV2thGsGDG3X5pmFRTOslD4M6BBCozTD9gXU/nGdco5PcRX0kwyAE/mk=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi036.front.sepia.ceph.com'} 2020-11-20T11:44:00.539 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:38:54.966833', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBADtDSAkTttY6RxvfujVCmKP9PcHmnO2Mjh8TGlXCZ7JYb4TL+TbqLQegRuu6m3slZhrVo5UwzLkCHl7ucNKDqE=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi188.front.sepia.ceph.com'} 2020-11-20T11:44:00.539 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-20T11:44:00.550 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2020-11-20T11:44:00.550 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2020-11-20T11:44:00.551 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2020-11-20T11:44:00.551 INFO:teuthology.run_tasks:Running task console_log... 2020-11-20T11:44:00.641 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc58472f268>, signals=[15]) 2020-11-20T11:44:00.642 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-20T11:44:00.650 INFO:teuthology.task.internal:Opening connections... 2020-11-20T11:44:00.651 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T11:44:00.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:44:00.730 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi036.front.sepia.ceph.com 2020-11-20T11:44:00.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:44:00.837 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T11:44:00.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:44:00.971 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-20T11:44:01.033 INFO:teuthology.orchestra.run.smithi164:> uname -m 2020-11-20T11:44:01.055 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2020-11-20T11:44:01.056 INFO:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2020-11-20T11:44:01.117 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:44:01.117 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:44:01.117 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2020-11-20T11:44:01.118 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2020-11-20T11:44:01.118 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.3" 2020-11-20T11:44:01.119 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:44:01.119 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:44:01.119 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2020-11-20T11:44:01.119 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:44:01.120 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:44:01.120 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:44:01.120 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:44:01.120 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:44:01.121 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:44:01.121 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:44:01.121 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:44:01.122 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2020-11-20T11:44:01.141 INFO:teuthology.orchestra.run.smithi036:> uname -m 2020-11-20T11:44:01.160 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2020-11-20T11:44:01.161 INFO:teuthology.orchestra.run.smithi036:> cat /etc/os-release 2020-11-20T11:44:01.217 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:44:01.217 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:44:01.217 INFO:teuthology.orchestra.run.smithi036.stdout:ID="rhel" 2020-11-20T11:44:01.217 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE="fedora" 2020-11-20T11:44:01.218 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="8.3" 2020-11-20T11:44:01.218 INFO:teuthology.orchestra.run.smithi036.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:44:01.218 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:44:01.218 INFO:teuthology.orchestra.run.smithi036.stdout:ANSI_COLOR="0;31" 2020-11-20T11:44:01.219 INFO:teuthology.orchestra.run.smithi036.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:44:01.219 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:44:01.219 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:44:01.219 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:44:01.219 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:44:01.220 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:44:01.220 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:44:01.220 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:44:01.220 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2020-11-20T11:44:01.240 INFO:teuthology.orchestra.run.smithi188:> uname -m 2020-11-20T11:44:01.261 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2020-11-20T11:44:01.262 INFO:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2020-11-20T11:44:01.324 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:44:01.325 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:44:01.326 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2020-11-20T11:44:01.326 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2020-11-20T11:44:01.326 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.3" 2020-11-20T11:44:01.327 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:44:01.327 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:44:01.327 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2020-11-20T11:44:01.328 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:44:01.328 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:44:01.329 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:44:01.329 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:44:01.329 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:44:01.330 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:44:01.330 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:44:01.330 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:44:01.331 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2020-11-20T11:44:01.358 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-20T11:44:02.964 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-20T11:44:03.073 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-20T11:44:03.073 INFO:teuthology.orchestra.run.smithi036:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:44:03.076 INFO:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:44:03.079 INFO:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:44:03.095 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-20T11:44:03.105 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-20T11:44:03.105 INFO:teuthology.orchestra.run.smithi036:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:44:03.133 INFO:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:44:03.136 INFO:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:44:03.290 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-20T11:44:03.359 INFO:teuthology.run_tasks:Running task kernel... 2020-11-20T11:44:03.380 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.9': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'osd.10': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.z': {'kdb': True, 'sha1': 'distro'}, 'mds.c': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.8': {'kdb': True, 'sha1': 'distro'}, 'osd.11': {'kdb': True, 'sha1': 'distro'}} 2020-11-20T11:44:03.381 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-11-20T11:44:03.381 INFO:teuthology.orchestra.run.smithi164:> uname -r 2020-11-20T11:44:03.398 INFO:teuthology.orchestra.run.smithi164.stdout:4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:44:03.398 INFO:teuthology.task.kernel:Running kernel on smithi164: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:44:03.399 INFO:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2020-11-20T11:44:05.052 INFO:teuthology.orchestra.run.smithi164.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:05.055 INFO:teuthology.orchestra.run.smithi164.stdout:Unable to read consumer identity 2020-11-20T11:44:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:44:05.162 INFO:teuthology.orchestra.run.smithi164.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:44:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:44:07.676 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 8.3 MB 00:01 2020-11-20T11:44:09.337 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 4.8 MB/s | 23 kB 00:00 2020-11-20T11:44:09.832 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-4.18.0-240.1.1.el8_3.x86_64 is already installed. 2020-11-20T11:44:09.832 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2020-11-20T11:44:09.937 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2020-11-20T11:44:09.948 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2020-11-20T11:44:09.949 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2020-11-20T11:44:10.065 INFO:teuthology.orchestra.run.smithi164:> echo no | sudo yum reinstall kernel || true 2020-11-20T11:44:10.336 INFO:teuthology.orchestra.run.smithi164.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:10.337 INFO:teuthology.orchestra.run.smithi164.stdout:Unable to read consumer identity 2020-11-20T11:44:10.385 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:44:10.385 INFO:teuthology.orchestra.run.smithi164.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:44:10.385 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:44:10.553 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Nov 2020 11:44:09 AM UTC. 2020-11-20T11:44:10.670 INFO:teuthology.orchestra.run.smithi164.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T11:44:10.670 INFO:teuthology.orchestra.run.smithi164.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T11:44:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:Error: No packages marked for reinstall. 2020-11-20T11:44:10.743 INFO:teuthology.orchestra.run.smithi164:> sudo yum reinstall -y kernel || true 2020-11-20T11:44:11.004 INFO:teuthology.orchestra.run.smithi164.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:11.005 INFO:teuthology.orchestra.run.smithi164.stdout:Unable to read consumer identity 2020-11-20T11:44:11.048 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:44:11.049 INFO:teuthology.orchestra.run.smithi164.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:44:11.049 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:44:11.213 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 11:44:09 AM UTC. 2020-11-20T11:44:11.353 INFO:teuthology.orchestra.run.smithi164.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T11:44:11.353 INFO:teuthology.orchestra.run.smithi164.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T11:44:11.379 INFO:teuthology.orchestra.run.smithi164.stderr:Error: No packages marked for reinstall. 2020-11-20T11:44:11.415 INFO:teuthology.orchestra.run.smithi164:> rpm -q kernel --last | head -n 1 2020-11-20T11:44:11.498 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-4.18.0-240.1.1.el8_3.x86_64 Tue 10 Nov 2020 09:16:49 PM UTC 2020-11-20T11:44:11.499 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:44:11.500 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T11:44:11.500 INFO:teuthology.orchestra.run.smithi036:> uname -r 2020-11-20T11:44:11.517 INFO:teuthology.orchestra.run.smithi036.stdout:4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:44:11.517 INFO:teuthology.task.kernel:Running kernel on smithi036: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:44:11.518 INFO:teuthology.orchestra.run.smithi036:> sudo yum install -y kernel 2020-11-20T11:44:12.962 INFO:teuthology.orchestra.run.smithi036.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:12.967 INFO:teuthology.orchestra.run.smithi036.stdout:Unable to read consumer identity 2020-11-20T11:44:13.051 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:44:13.051 INFO:teuthology.orchestra.run.smithi036.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:44:13.051 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:44:14.629 INFO:teuthology.orchestra.run.smithi036.stdout:Extra Packages for Enterprise Linux 24 MB/s | 8.3 MB 00:00 2020-11-20T11:44:16.479 INFO:teuthology.orchestra.run.smithi036.stdout:lab-extras 4.8 MB/s | 23 kB 00:00 2020-11-20T11:44:16.973 INFO:teuthology.orchestra.run.smithi036.stdout:Package kernel-4.18.0-240.1.1.el8_3.x86_64 is already installed. 2020-11-20T11:44:16.973 INFO:teuthology.orchestra.run.smithi036.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2020-11-20T11:44:17.072 INFO:teuthology.orchestra.run.smithi036.stdout:Dependencies resolved. 2020-11-20T11:44:17.083 INFO:teuthology.orchestra.run.smithi036.stdout:Nothing to do. 2020-11-20T11:44:17.083 INFO:teuthology.orchestra.run.smithi036.stdout:Complete! 2020-11-20T11:44:17.189 INFO:teuthology.orchestra.run.smithi036:> echo no | sudo yum reinstall kernel || true 2020-11-20T11:44:17.470 INFO:teuthology.orchestra.run.smithi036.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:17.471 INFO:teuthology.orchestra.run.smithi036.stdout:Unable to read consumer identity 2020-11-20T11:44:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:44:17.514 INFO:teuthology.orchestra.run.smithi036.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:44:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:44:17.696 INFO:teuthology.orchestra.run.smithi036.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Nov 2020 11:44:16 AM UTC. 2020-11-20T11:44:17.820 INFO:teuthology.orchestra.run.smithi036.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T11:44:17.821 INFO:teuthology.orchestra.run.smithi036.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T11:44:17.863 INFO:teuthology.orchestra.run.smithi036.stderr:Error: No packages marked for reinstall. 2020-11-20T11:44:17.900 INFO:teuthology.orchestra.run.smithi036:> sudo yum reinstall -y kernel || true 2020-11-20T11:44:18.178 INFO:teuthology.orchestra.run.smithi036.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:18.179 INFO:teuthology.orchestra.run.smithi036.stdout:Unable to read consumer identity 2020-11-20T11:44:18.238 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:44:18.239 INFO:teuthology.orchestra.run.smithi036.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:44:18.239 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:44:18.415 INFO:teuthology.orchestra.run.smithi036.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 11:44:16 AM UTC. 2020-11-20T11:44:18.527 INFO:teuthology.orchestra.run.smithi036.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T11:44:18.528 INFO:teuthology.orchestra.run.smithi036.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T11:44:18.565 INFO:teuthology.orchestra.run.smithi036.stderr:Error: No packages marked for reinstall. 2020-11-20T11:44:18.601 INFO:teuthology.orchestra.run.smithi036:> rpm -q kernel --last | head -n 1 2020-11-20T11:44:18.687 INFO:teuthology.orchestra.run.smithi036.stdout:kernel-4.18.0-240.1.1.el8_3.x86_64 Tue 10 Nov 2020 09:16:49 PM UTC 2020-11-20T11:44:18.688 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:44:18.688 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T11:44:18.689 INFO:teuthology.orchestra.run.smithi188:> uname -r 2020-11-20T11:44:18.706 INFO:teuthology.orchestra.run.smithi188.stdout:4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:44:18.707 INFO:teuthology.task.kernel:Running kernel on smithi188: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:44:18.707 INFO:teuthology.orchestra.run.smithi188:> sudo yum install -y kernel 2020-11-20T11:44:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:Unable to read consumer identity 2020-11-20T11:44:20.271 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:44:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:44:20.272 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:44:21.922 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 22 MB/s | 8.3 MB 00:00 2020-11-20T11:44:23.569 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 4.6 MB/s | 23 kB 00:00 2020-11-20T11:44:24.082 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-4.18.0-240.1.1.el8_3.x86_64 is already installed. 2020-11-20T11:44:24.084 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2020-11-20T11:44:24.188 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2020-11-20T11:44:24.195 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2020-11-20T11:44:24.195 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2020-11-20T11:44:24.293 INFO:teuthology.orchestra.run.smithi188:> echo no | sudo yum reinstall kernel || true 2020-11-20T11:44:24.557 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:24.558 INFO:teuthology.orchestra.run.smithi188.stdout:Unable to read consumer identity 2020-11-20T11:44:24.606 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:44:24.607 INFO:teuthology.orchestra.run.smithi188.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:44:24.607 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:44:24.778 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Nov 2020 11:44:23 AM UTC. 2020-11-20T11:44:24.901 INFO:teuthology.orchestra.run.smithi188.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T11:44:24.902 INFO:teuthology.orchestra.run.smithi188.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T11:44:24.935 INFO:teuthology.orchestra.run.smithi188.stderr:Error: No packages marked for reinstall. 2020-11-20T11:44:24.972 INFO:teuthology.orchestra.run.smithi188:> sudo yum reinstall -y kernel || true 2020-11-20T11:44:25.236 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:25.237 INFO:teuthology.orchestra.run.smithi188.stdout:Unable to read consumer identity 2020-11-20T11:44:25.279 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:44:25.279 INFO:teuthology.orchestra.run.smithi188.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:44:25.280 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:44:25.446 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 11:44:23 AM UTC. 2020-11-20T11:44:25.561 INFO:teuthology.orchestra.run.smithi188.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T11:44:25.562 INFO:teuthology.orchestra.run.smithi188.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T11:44:25.583 INFO:teuthology.orchestra.run.smithi188.stderr:Error: No packages marked for reinstall. 2020-11-20T11:44:25.623 INFO:teuthology.orchestra.run.smithi188:> rpm -q kernel --last | head -n 1 2020-11-20T11:44:25.712 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-4.18.0-240.1.1.el8_3.x86_64 Tue 10 Nov 2020 09:16:49 PM UTC 2020-11-20T11:44:25.713 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:44:25.714 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T11:44:25.714 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-11-20T11:44:25.714 INFO:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-20T11:44:25.749 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2020-11-20T11:44:25.769 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-11-20T11:44:25.769 INFO:teuthology.orchestra.run.smithi036:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-20T11:44:25.804 INFO:teuthology.orchestra.run.smithi036.stdout:ttyS1 2020-11-20T11:44:25.820 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2020-11-20T11:44:25.820 INFO:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-20T11:44:25.857 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2020-11-20T11:44:25.869 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-20T11:44:25.877 INFO:teuthology.task.internal:Creating test directory... 2020-11-20T11:44:25.877 INFO:teuthology.orchestra.run.smithi036:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:44:25.880 INFO:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:44:25.882 INFO:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:44:25.923 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-20T11:44:25.934 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-20T11:44:25.954 INFO:teuthology.task.internal:Creating archive directory... 2020-11-20T11:44:25.955 INFO:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:44:25.957 INFO:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:44:25.960 INFO:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:44:25.990 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-20T11:44:26.002 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-20T11:44:26.002 INFO:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:44:26.031 INFO:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:44:26.034 INFO:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:44:26.064 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:44:26.067 INFO:teuthology.orchestra.run.smithi036.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:44:26.071 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:44:26.074 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:44:26.079 INFO:teuthology.orchestra.run.smithi036.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:44:26.083 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:44:26.084 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-20T11:44:26.092 INFO:teuthology.task.internal:Configuring sudo... 2020-11-20T11:44:26.093 INFO:teuthology.orchestra.run.smithi036:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:44:26.127 INFO:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:44:26.129 INFO:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:44:26.154 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-20T11:44:26.163 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-20T11:44:26.164 INFO:teuthology.orchestra.run.smithi036:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:44:26.196 INFO:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:44:26.198 INFO:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:44:26.212 INFO:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:44:26.288 INFO:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:44:26.367 INFO:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:44:26.403 INFO:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:44:26.447 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:44:26.448 INFO:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:44:26.500 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:44:26.510 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:44:26.510 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:44:26.510 INFO:teuthology.orchestra.run.smithi164.stderr:152 bytes copied, 3.0894e-05 s, 4.9 MB/s 2020-11-20T11:44:26.511 INFO:teuthology.orchestra.run.smithi036:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:44:26.548 INFO:teuthology.orchestra.run.smithi036:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:44:26.625 INFO:teuthology.orchestra.run.smithi036:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:44:26.662 INFO:teuthology.orchestra.run.smithi036:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:44:26.716 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:44:26.716 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:44:26.771 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:44:26.782 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:44:26.783 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:44:26.783 INFO:teuthology.orchestra.run.smithi036.stderr:152 bytes copied, 3.527e-05 s, 4.3 MB/s 2020-11-20T11:44:26.784 INFO:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:44:26.819 INFO:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:44:26.873 INFO:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:44:26.947 INFO:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:44:26.995 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:44:26.995 INFO:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:44:27.048 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:44:27.058 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:44:27.058 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:44:27.059 INFO:teuthology.orchestra.run.smithi188.stderr:152 bytes copied, 3.2878e-05 s, 4.6 MB/s 2020-11-20T11:44:27.060 INFO:teuthology.orchestra.run.smithi036:> sudo service rsyslog restart 2020-11-20T11:44:27.062 INFO:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2020-11-20T11:44:27.065 INFO:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2020-11-20T11:44:27.122 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:44:27.134 INFO:teuthology.orchestra.run.smithi036.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:44:27.175 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:44:27.585 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-20T11:44:27.593 INFO:teuthology.task.internal:Starting timer... 2020-11-20T11:44:27.594 INFO:teuthology.run_tasks:Running task pcp... 2020-11-20T11:44:27.625 INFO:teuthology.run_tasks:Running task selinux... 2020-11-20T11:44:27.635 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-11-20T11:44:27.636 INFO:teuthology.orchestra.run.smithi036:> sudo service auditd rotate 2020-11-20T11:44:27.728 INFO:teuthology.orchestra.run.smithi036.stdout:Rotating logs: [ OK ] 2020-11-20T11:44:27.729 INFO:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2020-11-20T11:44:27.821 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: [ OK ] 2020-11-20T11:44:27.823 INFO:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2020-11-20T11:44:27.899 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: [ OK ] 2020-11-20T11:44:27.901 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-20T11:44:27.901 INFO:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2020-11-20T11:44:27.924 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2020-11-20T11:44:27.924 INFO:teuthology.orchestra.run.smithi036:> /usr/sbin/getenforce 2020-11-20T11:44:27.948 INFO:teuthology.orchestra.run.smithi036.stdout:Permissive 2020-11-20T11:44:27.948 INFO:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2020-11-20T11:44:27.967 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2020-11-20T11:44:27.968 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi164.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi036.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2020-11-20T11:44:27.968 INFO:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:44:27.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:44:27.993 INFO:teuthology.orchestra.run.smithi036:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:44:28.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:44:28.019 INFO:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:44:28.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:44:28.044 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-20T11:44:28.044 INFO:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:44:28.069 INFO:teuthology.orchestra.run.smithi036:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:44:28.094 INFO:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:44:28.118 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-20T11:44:28.129 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-11-20T11:44:28.135 INFO:teuthology.repo_utils:Fetching master from origin 2020-11-20T11:44:28.216 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-20T11:44:28.227 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-20T11:44:28.229 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi164.front.sepia.ceph.com,smithi036.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-20T11:44:28.573 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-20T11:44:29.524 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-20T11:44:32.067 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-20T11:44:32.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.073) 0:00:00.073 ******* 2020-11-20T11:44:32.100 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.012) 0:00:00.086 ******* 2020-11-20T11:44:32.114 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.013) 0:00:00.099 ******* 2020-11-20T11:44:33.579 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi036.front.sepia.ceph.com] 2020-11-20T11:44:33.628 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] 2020-11-20T11:44:33.678 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:01.563) 0:00:01.663 ******* 2020-11-20T11:44:33.721 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] 2020-11-20T11:44:33.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.102) 0:00:01.766 ******* 2020-11-20T11:44:33.821 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.040) 0:00:01.806 ******* 2020-11-20T11:44:34.009 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-11-20T11:44:34.010 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:44:34.056 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.235) 0:00:02.042 ******* 2020-11-20T11:44:34.097 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.041) 0:00:02.083 ******* 2020-11-20T11:44:34.131 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.033) 0:00:02.116 ******* 2020-11-20T11:44:34.455 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi188.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:44:34.495 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.363) 0:00:02.480 ******* 2020-11-20T11:44:34.503 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:44:34.505 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:44:34.539 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.044) 0:00:02.525 ******* 2020-11-20T11:44:34.569 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.029) 0:00:02.554 ******* 2020-11-20T11:44:34.574 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-11-20T11:44:34.576 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:34.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.051) 0:00:02.605 ******* 2020-11-20T11:44:34.660 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.040) 0:00:02.646 ******* 2020-11-20T11:44:34.666 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:34.706 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.041) 0:00:02.687 ******* 2020-11-20T11:44:34.924 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:44:34.926 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:44:34.928 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:44:34.962 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.259) 0:00:02.947 ******* 2020-11-20T11:44:34.992 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.030) 0:00:02.978 ******* 2020-11-20T11:44:35.024 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.031) 0:00:03.010 ******* 2020-11-20T11:44:35.745 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-11-20T11:44:35.747 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872675.0387332-92069168362854/source", "state": "file", "uid": 0} 2020-11-20T11:44:35.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.755) 0:00:03.766 ******* 2020-11-20T11:44:35.787 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872675.0054128-239677444802165/source", "state": "file", "uid": 0} 2020-11-20T11:44:35.787 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872674.976997-89607617884759/source", "state": "file", "uid": 0} 2020-11-20T11:44:35.822 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.042) 0:00:03.808 ******* 2020-11-20T11:44:35.853 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.030) 0:00:03.839 ******* 2020-11-20T11:44:36.250 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-11-20T11:44:36.252 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T11:44:36.254 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T11:44:36.286 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T11:44:36.288 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-11-20T11:44:36.290 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-11-20T11:44:36.291 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T11:44:36.467 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-20T11:44:36.474 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-20T11:44:36.619 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.765) 0:00:04.605 ******* 2020-11-20T11:44:36.650 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.030) 0:00:04.636 ******* 2020-11-20T11:44:36.681 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.030) 0:00:04.666 ******* 2020-11-20T11:44:37.260 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-11-20T11:44:37.263 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] 2020-11-20T11:44:37.272 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] 2020-11-20T11:44:37.352 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] 2020-11-20T11:44:37.403 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-11-20T11:44:37.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.723) 0:00:05.389 ******* 2020-11-20T11:44:37.451 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.047) 0:00:05.437 ******* 2020-11-20T11:44:37.539 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.088) 0:00:05.525 ******* 2020-11-20T11:44:37.897 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-20T11:44:37.900 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.194686", "end": "2020-11-20 11:44:37.874555", "rc": 0, "start": "2020-11-20 11:44:37.679869", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:44:37.934 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.394) 0:00:05.920 ******* 2020-11-20T11:44:37.941 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.177038", "end": "2020-11-20 11:44:37.881594", "rc": 0, "start": "2020-11-20 11:44:37.704556", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:44:37.943 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.189959", "end": "2020-11-20 11:44:37.879263", "rc": 0, "start": "2020-11-20 11:44:37.689304", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:44:37.977 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.042) 0:00:05.963 ******* 2020-11-20T11:44:38.009 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.031) 0:00:05.994 ******* 2020-11-20T11:44:38.142 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T11:44:38.144 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010697", "end": "2020-11-20 11:44:38.117119", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:44:38.106422", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:44:38.180 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.171) 0:00:06.165 ******* 2020-11-20T11:44:38.188 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011417", "end": "2020-11-20 11:44:38.155859", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:44:38.144442", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:44:38.246 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.066) 0:00:06.232 ******* 2020-11-20T11:44:38.254 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014668", "end": "2020-11-20 11:44:38.186282", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:44:38.171614", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:44:38.256 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T11:44:38.256 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T11:44:38.300 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.053) 0:00:06.285 ******* 2020-11-20T11:44:38.349 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.049) 0:00:06.335 ******* 2020-11-20T11:44:38.355 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T11:44:38.358 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.402 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.052) 0:00:06.388 ******* 2020-11-20T11:44:38.437 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.034) 0:00:06.423 ******* 2020-11-20T11:44:38.451 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T11:44:38.452 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.484 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.047) 0:00:06.470 ******* 2020-11-20T11:44:38.517 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.032) 0:00:06.502 ******* 2020-11-20T11:44:38.527 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.574 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.057) 0:00:06.560 ******* 2020-11-20T11:44:38.613 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.038) 0:00:06.598 ******* 2020-11-20T11:44:38.619 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-20T11:44:38.621 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.662 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.049) 0:00:06.648 ******* 2020-11-20T11:44:38.694 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.031) 0:00:06.680 ******* 2020-11-20T11:44:38.701 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-20T11:44:38.704 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.737 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.043) 0:00:06.723 ******* 2020-11-20T11:44:38.771 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.033) 0:00:06.756 ******* 2020-11-20T11:44:38.779 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-20T11:44:38.781 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.819 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.048) 0:00:06.805 ******* 2020-11-20T11:44:38.828 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:44:38.830 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.831 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.833 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2020-11-20T11:44:38.835 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.870 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.051) 0:00:06.856 ******* 2020-11-20T11:44:38.878 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-20T11:44:38.881 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.885 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.889 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rae 2020-11-20T11:44:38.891 INFO:teuthology.task.ansible.out:l 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.929 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.058) 0:00:06.914 ******* 2020-11-20T11:44:38.940 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.942 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.943 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.944 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:44:38.944 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', ' 2020-11-20T11:44:38.946 INFO:teuthology.task.ansible.out:ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru 2020-11-20T11:44:38.948 INFO:teuthology.task.ansible.out:8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.984 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.053) 0:00:06.968 ******* 2020-11-20T11:44:39.001 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditiona 2020-11-20T11:44:39.003 INFO:teuthology.task.ansible.out:l result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae 2020-11-20T11:44:39.006 INFO:teuthology.task.ansible.out:58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.039 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.056) 0:00:07.025 ******* 2020-11-20T11:44:39.046 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.048 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.053 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [sm 2020-11-20T11:44:39.056 INFO:teuthology.task.ansible.out:ithi036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.047) 0:00:07.073 ******* 2020-11-20T11:44:39.096 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.098 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.099 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.099 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was 2020-11-20T11:44:39.101 INFO:teuthology.task.ansible.out:False"} 2020-11-20T11:44:39.136 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.048) 0:00:07.121 ******* 2020-11-20T11:44:39.143 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.145 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.146 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.147 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vasu', ' 2020-11-20T11:44:39.150 INFO:teuthology.task.ansible.out:ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.161 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.162 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.164 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.166 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.168 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.170 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": " 2020-11-20T11:44:39.173 INFO:teuthology.task.ansible.out:pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.180 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.182 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.192 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.195 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.204 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.207 INFO:teuthology.task.ansible.out: skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.207 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.218 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.220 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.230 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.231 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:39.234 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_lo 2020-11-20T11:44:39.236 INFO:teuthology.task.ansible.out:op_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac155 2020-11-20T11:44:39.238 INFO:teuthology.task.ansible.out:8292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.248 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.249 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.250 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:39.250 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.252 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:39.263 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.267 INFO:teuthology.task.ansible.out: skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZc 2020-11-20T11:44:39.269 INFO:teuthology.task.ansible.out:O4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169db 2020-11-20T11:44:39.272 INFO:teuthology.task.ansible.out:e3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.279 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.281 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.297 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_ 2020-11-20T11:44:39.300 INFO:teuthology.task.ansible.out:var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.300 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.302 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.309 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.317 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.318 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.ar 2020-11-20T11:44:39.320 INFO:teuthology.task.ansible.out:bor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.330 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.332 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 2020-11-20T11:44:39.335 INFO:teuthology.task.ansible.out:31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.345 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.348 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "chang 2020-11-20T11:44:39.349 INFO:teuthology.task.ansible.out:ed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.362 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bP 2020-11-20T11:44:39.364 INFO:teuthology.task.ansible.out:DovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.377 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn" 2020-11-20T11:44:39.379 INFO:teuthology.task.ansible.out:: "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.389 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.393 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhI 2020-11-20T11:44:39.395 INFO:teuthology.task.ansible.out:ehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d 2020-11-20T11:44:39.396 INFO:teuthology.task.ansible.out:9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.404 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.406 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bI 2020-11-20T11:44:39.409 INFO:teuthology.task.ansible.out:TfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9ic 2020-11-20T11:44:39.410 INFO:teuthology.task.ansible.out:AtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.420 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.423 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchan 2020-11-20T11:44:39.425 INFO:teuthology.task.ansible.out:gir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.426 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.426 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.428 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.430 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.436 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:39.437 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.439 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.441 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.441 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.453 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.456 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caa 2020-11-20T11:44:39.458 INFO:teuthology.task.ansible.out:eecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.467 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.469 INFO:teuthology.task.ansible.out: skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.470 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.471 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f9 2020-11-20T11:44:39.473 INFO:teuthology.task.ansible.out:19437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.484 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.485 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.486 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.486 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.488 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.499 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.500 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.501 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f91 2020-11-20T11:44:39.502 INFO:teuthology.task.ansible.out:9437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.513 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.514 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.515 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': ' 2020-11-20T11:44:39.517 INFO:teuthology.task.ansible.out:h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIY 2020-11-20T11:44:39.518 INFO:teuthology.task.ansible.out:zUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.528 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.530 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.530 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat 2020-11-20T11:44:39.532 INFO:teuthology.task.ansible.out:aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.544 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.547 INFO:teuthology.task.ansible.out: skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.548 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.560 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.563 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.617 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item= 2020-11-20T11:44:39.633 INFO:teuthology.task.ansible.out:{'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d 2020-11-20T11:44:39.640 INFO:teuthology.task.ansible.out:4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c 2020-11-20T11:44:39.642 INFO:teuthology.task.ansible.out:5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a 2020-11-20T11:44:39.644 INFO:teuthology.task.ansible.out:0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5C 2020-11-20T11:44:39.646 INFO:teuthology.task.ansible.out:iGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b 2020-11-20T11:44:39.650 INFO:teuthology.task.ansible.out:5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi03 2020-11-20T11:44:39.652 INFO:teuthology.task.ansible.out:6.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'hen 2020-11-20T11:44:39.657 INFO:teuthology.task.ansible.out:rix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6 2020-11-20T11:44:39.659 INFO:teuthology.task.ansible.out:d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_va 2020-11-20T11:44:39.661 INFO:teuthology.task.ansible.out:r": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1 2020-11-20T11:44:39.662 INFO:teuthology.task.ansible.out:108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97 2020-11-20T11:44:39.664 INFO:teuthology.task.ansible.out:dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.669 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.672 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.673 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf8 2020-11-20T11:44:39.675 INFO:teuthology.task.ansible.out:5db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.685 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.687 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.689 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.699 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.702 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.715 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.717 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.725 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.728 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.728 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.728 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34b 2020-11-20T11:44:39.730 INFO:teuthology.task.ansible.out:c0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.742 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.744 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.755 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.758 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.768 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.771 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 2020-11-20T11:44:39.772 INFO:teuthology.task.ansible.out: YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn 2020-11-20T11:44:39.775 INFO:teuthology.task.ansible.out:": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name 2020-11-20T11:44:39.778 INFO:teuthology.task.ansible.out:': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd 2020-11-20T11:44:39.780 INFO:teuthology.task.ansible.out:599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.786 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.788 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.788 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.789 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": " 2020-11-20T11:44:39.790 INFO:teuthology.task.ansible.out:julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.808 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.810 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.845 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.708) 0:00:07.830 ******* 2020-11-20T11:44:39.852 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.853 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.854 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.856 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.859 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.870 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.871 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.872 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7 2020-11-20T11:44:39.873 INFO:teuthology.task.ansible.out:X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.874 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.874 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.875 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a 2020-11-20T11:44:39.876 INFO:teuthology.task.ansible.out:4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** 2020-11-20T11:44:39.911 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.065) 0:00:07.896 ******* 2020-11-20T11:44:39.917 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:44:39.919 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.919 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@z 2020-11-20T11:44:39.921 INFO:teuthology.task.ansible.out:ulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.921 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.922 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.922 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80b 2020-11-20T11:44:39.924 INFO:teuthology.task.ansible.out:f3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.933 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.935 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.936 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.937 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-20T11:44:39.938 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.938 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:44:39.938 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.940 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.072) 0:00:07.968 ******* 2020-11-20T11:44:39.989 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.991 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.991 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.993 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.993 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.994 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.994 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXL 2020-11-20T11:44:39.996 INFO:teuthology.task.ansible.out:UV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.996 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", " 2020-11-20T11:44:39.998 INFO:teuthology.task.ansible.out:changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.009 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.010 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.010 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.012 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.014 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.014 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.016 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.018 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.018 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.019 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168 2020-11-20T11:44:40.020 INFO:teuthology.task.ansible.out:e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.057 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.074) 0:00:08.042 ******* 2020-11-20T11:44:40.065 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.066 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.067 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.068 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.070 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.071 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.071 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pd 2020-11-20T11:44:40.073 INFO:teuthology.task.ansible.out:hange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.091 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.108 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.142 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.085) 0:00:08.128 ******* 2020-11-20T11:44:40.174 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.032) 0:00:08.160 ******* 2020-11-20T11:44:40.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.030) 0:00:08.190 ******* 2020-11-20T11:44:40.210 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T11:44:40.212 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** 2020-11-20T11:44:40.248 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.043) 0:00:08.234 ******* 2020-11-20T11:44:40.280 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.032) 0:00:08.266 ******* 2020-11-20T11:44:40.287 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T11:44:40.289 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.327 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.047) 0:00:08.313 ******* 2020-11-20T11:44:40.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.038) 0:00:08.351 ******* 2020-11-20T11:44:40.372 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-20T11:44:40.374 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi036.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.374 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.415 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.049) 0:00:08.401 ******* 2020-11-20T11:44:40.423 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.425 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:44:40.425 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.426 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.427 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.471 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.054) 0:00:08.457 ******* 2020-11-20T11:44:40.480 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.480 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-20T11:44:40.481 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.481 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi036.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.482 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.483 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.522 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.050) 0:00:08.507 ******* 2020-11-20T11:44:40.529 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.530 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.530 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.532 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} TASK [users : Clone the keys repo] ********************************************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.532 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:44:40.533 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.534 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.535 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.535 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.535 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.536 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.537 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.571 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.048) 0:00:08.556 ******* 2020-11-20T11:44:40.577 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.578 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:44:40.579 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.580 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.580 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.581 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.581 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.581 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.582 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.582 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.617 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.046) 0:00:08.603 ******* 2020-11-20T11:44:40.624 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.626 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-20T11:44:40.626 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.626 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:44:40.627 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.627 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.628 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.629 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.667 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.049) 0:00:08.652 ******* 2020-11-20T11:44:40.699 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.032) 0:00:08.685 ******* 2020-11-20T11:44:40.705 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T11:44:40.707 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.743 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.043) 0:00:08.728 ******* 2020-11-20T11:44:40.749 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.792 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.049) 0:00:08.778 ******* 2020-11-20T11:44:40.801 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.841 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.049) 0:00:08.827 ******* 2020-11-20T11:44:40.849 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.886 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.043) 0:00:08.870 ******* 2020-11-20T11:44:40.891 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:44:40.893 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.903 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.905 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.915 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.918 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.929 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.931 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.931 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.932 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.933 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.934 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.945 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.947 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.958 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.960 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.971 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.973 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.974 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.976 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.987 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.991 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.999 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.001 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.001 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.002 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.002 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.013 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.015 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.028 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.029 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.030 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.030 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.031 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.042 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.045 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.054 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.066 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.069 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.078 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.080 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.080 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.081 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.081 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.081 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.082 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.082 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.094 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.096 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.097 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.108 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.109 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.114 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.115 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.115 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.266) 0:00:09.137 ******* 2020-11-20T11:44:41.158 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.159 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.160 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.160 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.162 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.162 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.202 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.050) 0:00:09.187 ******* 2020-11-20T11:44:41.203 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:41.385 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T11:44:41.387 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:44:41.420 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.218) 0:00:09.406 ******* 2020-11-20T11:44:41.447 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T11:44:41.453 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => { "msg": "Host smithi036.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T11:44:41.488 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.067) 0:00:09.473 ******* 2020-11-20T11:44:41.526 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T11:44:41.527 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-20T11:44:41.560 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.072) 0:00:09.546 ******* 2020-11-20T11:44:41.577 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T11:44:41.579 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:44:41.612 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.052) 0:00:09.598 ******* 2020-11-20T11:44:41.618 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:44:41.620 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.652 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.039) 0:00:09.638 ******* 2020-11-20T11:44:41.659 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T11:44:41.660 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} TASK [common : Log the OS name, version and release] *************************** ok: [smithi164.front.sepia.ceph.com] => { "msg": "Host smithi164.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T11:44:41.696 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.042) 0:00:09.681 ******* 2020-11-20T11:44:41.729 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.033) 0:00:09.714 ******* 2020-11-20T11:44:41.734 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T11:44:41.736 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-20T11:44:41.771 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.041) 0:00:09.756 ******* 2020-11-20T11:44:41.777 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T11:44:41.778 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => { "msg": "Host smithi188.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T11:44:41.814 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.043) 0:00:09.800 ******* 2020-11-20T11:44:41.820 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:44:41.822 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.858 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.043) 0:00:09.844 ******* 2020-11-20T11:44:41.866 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi188.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-20T11:44:41.909 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.050) 0:00:09.894 ******* 2020-11-20T11:44:41.941 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:44:41.943 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.979 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.070) 0:00:09.965 ******* 2020-11-20T11:44:42.147 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T11:44:42.147 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.304517", "end": "2020-11-20 11:44:42.120073", "rc": 0, "start": "2020-11-20 11:44:41.815556", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T11:44:42.185 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.205) 0:00:10.171 ******* 2020-11-20T11:44:42.212 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T11:44:42.214 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.248 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.062) 0:00:10.234 ******* 2020-11-20T11:44:42.275 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T11:44:42.276 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.309 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.060) 0:00:10.294 ******* 2020-11-20T11:44:42.335 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T11:44:42.337 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.373 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.064) 0:00:10.359 ******* 2020-11-20T11:44:42.401 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T11:44:42.403 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.316912", "end": "2020-11-20 11:44:42.382170", "rc": 0, "start": "2020-11-20 11:44:42.065258", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T11:44:42.452 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.078) 0:00:10.437 ******* 2020-11-20T11:44:42.493 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.040) 0:00:10.478 ******* 2020-11-20T11:44:42.503 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.284824", "end": "2020-11-20 11:44:42.430270", "rc": 0, "start": "2020-11-20 11:44:42.145446", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.539 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.046) 0:00:10.525 ******* 2020-11-20T11:44:42.570 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.031) 0:00:10.556 ******* 2020-11-20T11:44:42.575 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T11:44:42.576 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.578 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-11-20T11:44:42.613 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.042) 0:00:10.598 ******* 2020-11-20T11:44:42.645 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.031) 0:00:10.630 ******* 2020-11-20T11:44:42.651 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T11:44:42.653 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.686 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.041) 0:00:10.672 ******* 2020-11-20T11:44:42.692 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T11:44:42.693 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.728 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.042) 0:00:10.714 ******* 2020-11-20T11:44:42.759 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.030) 0:00:10.745 ******* 2020-11-20T11:44:42.765 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.767 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-20T11:44:42.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.043) 0:00:10.788 ******* 2020-11-20T11:44:42.837 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.034) 0:00:10.823 ******* 2020-11-20T11:44:42.844 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T11:44:43.606 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:44:42 +0000 (0:00:00.044) 0:00:10.867 ******* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:44:42 +0000 (0:00:00.041) 0:00:10.909 ******* TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:44:42 +0000 (0:00:00.042) 0:00:10.951 ******* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:44:43 +0000 (0:00:00.043) 0:00:10.995 ******* TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:44:43 +0000 (0:00:00.041) 0:00:11.036 ******* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:44:43 +0000 (0:00:00.047) 0:00:11.084 ******* TASK [common : Set entitlements_path] ****************************************** ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} Friday 20 November 2020 11:44:43 +0000 (0:00:00.064) 0:00:11.148 ******* ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} Friday 20 November 2020 11:44:43 +0000 (0:00:00.052) 0:00:11.201 ******* TASK [common : Include Red Hat encrypted variables.] *************************** ok: [smithi164.front.sepia.ceph.com] => (item=No 2020-11-20T11:44:43.608 INFO:teuthology.task.ansible.out:ne) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi164.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Friday 20 November 2020 11:44:43 +0000 (0:00:00.044) 0:00:11.245 ******* ok: [smithi188.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi188.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Friday 20 November 2020 11:44:43 +0000 (0:00:00.055) 0:00:11.300 ******* TASK [common : Set have_entitlements] ****************************************** ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} Friday 20 November 2020 11:44:43 +0000 (0:00:00.041) 0:00:11.342 ******* ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} Friday 20 November 2020 11:44:43 +0000 (0:00:00.041) 0:00:11.384 ******* 2020-11-20T11:44:44.031 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605872683.8869243-wgiurh4l/katello-ca-consumer-latest.noarchc3e5i42_.rpm"]} 2020-11-20T11:44:44.079 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.680) 0:00:12.065 ******* 2020-11-20T11:44:44.235 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605872684.1035736-5q3hqzpi/katello-ca-consumer-latest.noarchgzu125ah.rpm"]} 2020-11-20T11:44:44.270 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.191) 0:00:12.256 ******* 2020-11-20T11:44:44.324 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605872684.1893127-eb5d3f4g/katello-ca-consumer-latest.noarchn6swlknw.rpm"]} 2020-11-20T11:44:44.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.095) 0:00:12.351 ******* 2020-11-20T11:44:44.650 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T11:44:44.653 INFO:teuthology.task.ansible.out:fatal: [smithi036.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T11:44:44.686 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.320) 0:00:12.671 ******* 2020-11-20T11:44:44.724 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T11:44:44.725 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T11:44:44.763 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.076) 0:00:12.748 ******* 2020-11-20T11:44:44.866 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T11:44:44.868 INFO:teuthology.task.ansible.out:fatal: [smithi164.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T11:44:44.917 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.154) 0:00:12.903 ******* 2020-11-20T11:44:44.927 INFO:teuthology.task.ansible.out:fatal: [smithi188.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T11:44:44.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.063) 0:00:12.967 ******* 2020-11-20T11:44:44.990 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T11:44:44.992 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T11:44:45.028 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:45 +0000 (0:00:00.046) 0:00:13.014 ******* 2020-11-20T11:44:45.037 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T11:44:45.078 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:45 +0000 (0:00:00.050) 0:00:13.064 ******* 2020-11-20T11:44:59.588 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T11:44:59.590 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:44:59.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:59 +0000 (0:00:14.544) 0:00:27.608 ******* 2020-11-20T11:44:59.661 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T11:44:59.662 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-20T11:44:59.695 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:59 +0000 (0:00:00.072) 0:00:27.680 ******* 2020-11-20T11:45:00.271 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T11:45:00.273 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.376011", "end": "2020-11-20 11:45:00.234711", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:44:59.858700", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T11:45:00.305 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:00 +0000 (0:00:00.610) 0:00:28.291 ******* 2020-11-20T11:45:00.343 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T11:45:00.345 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:00.377 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:00 +0000 (0:00:00.071) 0:00:28.363 ******* 2020-11-20T11:45:00.405 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T11:45:00.407 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:00.438 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:00 +0000 (0:00:00.061) 0:00:28.424 ******* 2020-11-20T11:45:00.465 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T11:45:00.467 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:45:00.499 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:00 +0000 (0:00:00.060) 0:00:28.485 ******* 2020-11-20T11:45:00.526 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:45:00.528 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:00.560 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:00 +0000 (0:00:00.060) 0:00:28.546 ******* 2020-11-20T11:45:00.597 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T11:45:00.599 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:45:00.633 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:00 +0000 (0:00:00.073) 0:00:28.619 ******* 2020-11-20T11:45:00.671 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T11:45:00.672 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-20T11:45:00.708 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:00 +0000 (0:00:00.074) 0:00:28.693 ******* 2020-11-20T11:45:01.258 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T11:45:01.260 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:45:01.297 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:01 +0000 (0:00:00.589) 0:00:29.282 ******* 2020-11-20T11:45:01.307 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.374768", "end": "2020-11-20 11:45:01.263317", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:45:00.888549", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T11:45:01.372 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:01 +0000 (0:00:00.074) 0:00:29.357 ******* 2020-11-20T11:45:01.383 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T11:45:01.386 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-20T11:45:01.434 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:01 +0000 (0:00:00.063) 0:00:29.420 ******* 2020-11-20T11:45:01.443 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T11:45:01.444 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:01.489 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:01 +0000 (0:00:00.051) 0:00:29.471 ******* 2020-11-20T11:45:01.517 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:01.566 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:01 +0000 (0:00:00.079) 0:00:29.551 ******* 2020-11-20T11:45:01.594 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi188.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:45:01.631 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:01 +0000 (0:00:00.066) 0:00:29.617 ******* 2020-11-20T11:45:01.674 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:01.711 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:01 +0000 (0:00:00.079) 0:00:29.697 ******* 2020-11-20T11:45:02.055 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T11:45:02.058 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.394023", "end": "2020-11-20 11:45:02.027166", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:45:01.633143", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T11:45:02.091 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:02 +0000 (0:00:00.380) 0:00:30.077 ******* 2020-11-20T11:45:02.119 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T11:45:02.123 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:02.154 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:02 +0000 (0:00:00.063) 0:00:30.140 ******* 2020-11-20T11:45:02.192 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:02.227 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:02 +0000 (0:00:00.072) 0:00:30.212 ******* 2020-11-20T11:45:02.246 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T11:45:02.253 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:45:02.279 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:02 +0000 (0:00:00.052) 0:00:30.265 ******* 2020-11-20T11:45:02.318 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:45:02.320 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:02.355 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:02 +0000 (0:00:00.076) 0:00:30.341 ******* 2020-11-20T11:45:03.033 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:45:03.034 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.287349", "end": "2020-11-20 11:45:03.010021", "rc": 0, "start": "2020-11-20 11:45:00.722672", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T11:45:03.072 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:03 +0000 (0:00:00.716) 0:00:31.057 ******* 2020-11-20T11:45:03.111 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T11:45:03.113 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T11:45:03.145 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:03 +0000 (0:00:00.073) 0:00:31.131 ******* 2020-11-20T11:45:03.184 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T11:45:03.186 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:03.217 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:03 +0000 (0:00:00.072) 0:00:31.203 ******* 2020-11-20T11:45:03.256 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:45:03.258 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T11:45:03.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:03 +0000 (0:00:00.073) 0:00:31.277 ******* 2020-11-20T11:45:03.330 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T11:45:03.333 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T11:45:03.367 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:03 +0000 (0:00:00.075) 0:00:31.353 ******* 2020-11-20T11:45:04.203 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:45:04.204 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.275491", "end": "2020-11-20 11:45:04.178077", "rc": 0, "start": "2020-11-20 11:45:01.902586", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T11:45:04.238 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:04 +0000 (0:00:00.870) 0:00:32.224 ******* 2020-11-20T11:45:04.275 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T11:45:04.277 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T11:45:04.309 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:04 +0000 (0:00:00.071) 0:00:32.295 ******* 2020-11-20T11:45:04.347 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T11:45:04.348 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:04.380 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:04 +0000 (0:00:00.070) 0:00:32.366 ******* 2020-11-20T11:45:04.420 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:45:04.421 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T11:45:04.453 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:04 +0000 (0:00:00.072) 0:00:32.438 ******* 2020-11-20T11:45:04.491 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T11:45:04.493 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T11:45:04.526 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:04 +0000 (0:00:00.072) 0:00:32.511 ******* 2020-11-20T11:45:05.032 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:45:05.034 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.470555", "end": "2020-11-20 11:45:05.010405", "rc": 0, "start": "2020-11-20 11:45:02.539850", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T11:45:05.066 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:05 +0000 (0:00:00.540) 0:00:33.052 ******* 2020-11-20T11:45:05.115 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T11:45:05.116 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T11:45:05.148 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:05 +0000 (0:00:00.082) 0:00:33.134 ******* 2020-11-20T11:45:05.187 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:05.223 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:05 +0000 (0:00:00.073) 0:00:33.208 ******* 2020-11-20T11:45:05.260 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:45:05.262 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T11:45:05.294 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:05 +0000 (0:00:00.071) 0:00:33.279 ******* 2020-11-20T11:45:05.332 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T11:45:05.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:05 +0000 (0:00:00.072) 0:00:33.352 ******* 2020-11-20T11:45:05.830 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi164.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:45:05.867 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:05 +0000 (0:00:00.501) 0:00:33.853 ******* 2020-11-20T11:45:06.980 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:45:07.024 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:07 +0000 (0:00:01.156) 0:00:35.009 ******* 2020-11-20T11:45:08.021 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:45:08.056 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:08 +0000 (0:00:01.031) 0:00:36.041 ******* 2020-11-20T11:45:09.300 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T11:45:09.303 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.234398", "end": "2020-11-20 11:45:09.269833", "rc": 0, "start": "2020-11-20 11:45:06.035435", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T11:45:09.338 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:09 +0000 (0:00:01.281) 0:00:37.323 ******* 2020-11-20T11:45:09.552 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T11:45:09.554 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T11:45:09.589 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:09 +0000 (0:00:00.251) 0:00:37.575 ******* 2020-11-20T11:45:09.780 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi164.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:45:09.823 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:09 +0000 (0:00:00.234) 0:00:37.809 ******* 2020-11-20T11:45:10.286 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:45:10.288 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:45:10.520 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T11:45:10.522 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.282562", "end": "2020-11-20 11:45:10.492539", "rc": 0, "start": "2020-11-20 11:45:07.209977", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T11:45:10.555 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:10 +0000 (0:00:00.731) 0:00:38.540 ******* 2020-11-20T11:45:10.700 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:45:10.701 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:45:10.744 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:10 +0000 (0:00:00.187) 0:00:38.728 ******* 2020-11-20T11:45:10.748 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T11:45:10.750 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T11:45:10.784 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:10 +0000 (0:00:00.042) 0:00:38.770 ******* 2020-11-20T11:45:10.972 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:45:11.007 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:11 +0000 (0:00:00.222) 0:00:38.993 ******* 2020-11-20T11:45:11.233 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:45:11.236 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:45:11.484 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:45:11.486 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:45:11.679 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:45:11.681 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:45:11.715 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:11 +0000 (0:00:00.707) 0:00:39.701 ******* 2020-11-20T11:45:11.745 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:45:11.747 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:11.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:11 +0000 (0:00:00.063) 0:00:39.764 ******* 2020-11-20T11:45:11.806 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:45:11.808 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:11.842 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:11 +0000 (0:00:00.063) 0:00:39.827 ******* 2020-11-20T11:45:11.871 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T11:45:11.871 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:11.907 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:11 +0000 (0:00:00.065) 0:00:39.893 ******* 2020-11-20T11:45:11.923 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:45:11.925 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:45:11.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:11 +0000 (0:00:00.074) 0:00:39.967 ******* 2020-11-20T11:45:11.988 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T11:45:11.990 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.693764", "end": "2020-11-20 11:45:11.921988", "rc": 0, "start": "2020-11-20 11:45:08.228224", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T11:45:12.027 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:12 +0000 (0:00:00.044) 0:00:40.011 ******* 2020-11-20T11:45:12.057 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:12 +0000 (0:00:00.031) 0:00:40.043 ******* 2020-11-20T11:45:12.084 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:45:12.085 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:12.130 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:12 +0000 (0:00:00.070) 0:00:40.113 ******* 2020-11-20T11:45:12.155 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:12.189 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:12 +0000 (0:00:00.061) 0:00:40.175 ******* 2020-11-20T11:45:12.216 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T11:45:12.218 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:12.251 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:12 +0000 (0:00:00.061) 0:00:40.236 ******* 2020-11-20T11:45:12.265 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T11:45:12.267 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T11:45:12.300 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:12 +0000 (0:00:00.048) 0:00:40.285 ******* 2020-11-20T11:45:12.306 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T11:45:12.308 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:12.342 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:12 +0000 (0:00:00.042) 0:00:40.328 ******* 2020-11-20T11:45:12.372 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:12.406 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:12 +0000 (0:00:00.064) 0:00:40.392 ******* 2020-11-20T11:45:12.457 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:45:12.459 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:45:12.512 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T11:45:12.514 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:45:12.549 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:12 +0000 (0:00:00.141) 0:00:40.534 ******* 2020-11-20T11:45:12.959 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:45:12.961 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:45:12.997 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:12 +0000 (0:00:00.447) 0:00:40.982 ******* 2020-11-20T11:45:13.034 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:13.035 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:45:13.035 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:45:13.070 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.073) 0:00:41.055 ******* 2020-11-20T11:45:13.097 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:45:13.099 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:13.132 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.062) 0:00:41.118 ******* 2020-11-20T11:45:13.160 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T11:45:13.162 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:13.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.073) 0:00:41.191 ******* 2020-11-20T11:45:13.236 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:13.282 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.076) 0:00:41.267 ******* 2020-11-20T11:45:13.312 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:13.364 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.082) 0:00:41.350 ******* 2020-11-20T11:45:13.395 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T11:45:13.397 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:13.429 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.065) 0:00:41.415 ******* 2020-11-20T11:45:13.457 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:13.490 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.061) 0:00:41.476 ******* 2020-11-20T11:45:13.517 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T11:45:13.518 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:13.520 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.926345", "end": "2020-11-20 11:45:13.500339", "rc": 0, "start": "2020-11-20 11:45:12.573994", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:45:13.554 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.063) 0:00:41.540 ******* 2020-11-20T11:45:13.595 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.040) 0:00:41.581 ******* 2020-11-20T11:45:13.603 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:45:13.605 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:45:13.641 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.046) 0:00:41.627 ******* 2020-11-20T11:45:13.649 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:13.688 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:13 +0000 (0:00:00.045) 0:00:41.673 ******* 2020-11-20T11:45:14.152 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:45:14.154 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:45:14.617 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:45:14.655 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:14 +0000 (0:00:00.967) 0:00:42.641 ******* 2020-11-20T11:45:14.682 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:45:14.684 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:14.720 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:14 +0000 (0:00:00.064) 0:00:42.706 ******* 2020-11-20T11:45:14.747 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:45:14.749 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:14.798 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:14 +0000 (0:00:00.077) 0:00:42.783 ******* 2020-11-20T11:45:14.828 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:14.870 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:14 +0000 (0:00:00.072) 0:00:42.856 ******* 2020-11-20T11:45:14.898 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T11:45:14.900 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:14.933 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:14 +0000 (0:00:00.062) 0:00:42.918 ******* 2020-11-20T11:45:14.960 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:45:14.962 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:15.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:15 +0000 (0:00:00.072) 0:00:42.991 ******* 2020-11-20T11:45:15.036 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:15.072 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:15 +0000 (0:00:00.064) 0:00:43.056 ******* 2020-11-20T11:45:15.097 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T11:45:15.099 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:15.132 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:15 +0000 (0:00:00.062) 0:00:43.118 ******* 2020-11-20T11:45:15.160 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T11:45:15.161 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:15.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:15 +0000 (0:00:00.080) 0:00:43.198 ******* 2020-11-20T11:45:15.241 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:15.274 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:15 +0000 (0:00:00.061) 0:00:43.260 ******* 2020-11-20T11:45:15.527 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T11:45:15.529 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.055654", "end": "2020-11-20 11:45:15.500345", "rc": 0, "start": "2020-11-20 11:45:15.444691", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.660785", "end": "2020-11-20 11:45:15.501279", "rc": 0, "start": "2020-11-20 11:45:13.840494", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:45:15.567 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:15 +0000 (0:00:00.293) 0:00:43.553 ******* 2020-11-20T11:45:15.613 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:15 +0000 (0:00:00.045) 0:00:43.599 ******* 2020-11-20T11:45:16.327 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T11:45:16.329 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:45:16.372 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:16 +0000 (0:00:00.759) 0:00:44.358 ******* 2020-11-20T11:45:16.400 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:45:16.401 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:16.453 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:16 +0000 (0:00:00.080) 0:00:44.438 ******* 2020-11-20T11:45:16.483 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:16.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:16 +0000 (0:00:00.064) 0:00:44.503 ******* 2020-11-20T11:45:16.544 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:45:16.546 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:16.578 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:16 +0000 (0:00:00.061) 0:00:44.564 ******* 2020-11-20T11:45:16.617 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T11:45:16.619 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:16.662 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:16 +0000 (0:00:00.083) 0:00:44.648 ******* 2020-11-20T11:45:17.092 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T11:45:17.094 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:45:17.125 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:17 +0000 (0:00:00.463) 0:00:45.111 ******* 2020-11-20T11:45:18.423 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T11:45:18.425 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:45:18.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:18 +0000 (0:00:01.333) 0:00:46.445 ******* 2020-11-20T11:45:18.486 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:45:18.488 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:18.527 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:18 +0000 (0:00:00.067) 0:00:46.512 ******* 2020-11-20T11:45:18.555 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T11:45:18.557 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:18.590 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:18 +0000 (0:00:00.062) 0:00:46.575 ******* 2020-11-20T11:45:18.608 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:45:18.643 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:18 +0000 (0:00:00.052) 0:00:46.628 ******* 2020-11-20T11:45:18.649 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:45:18.651 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:18.684 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:18 +0000 (0:00:00.041) 0:00:46.670 ******* 2020-11-20T11:45:18.690 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:45:18.691 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:18.726 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:18 +0000 (0:00:00.041) 0:00:46.711 ******* 2020-11-20T11:45:18.733 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T11:45:18.734 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:18.767 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:18 +0000 (0:00:00.041) 0:00:46.753 ******* 2020-11-20T11:45:18.773 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T11:45:18.775 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:18.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:18 +0000 (0:00:00.042) 0:00:46.796 ******* 2020-11-20T11:45:18.837 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:45:18.839 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:18.871 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:18 +0000 (0:00:00.061) 0:00:46.857 ******* 2020-11-20T11:45:18.898 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T11:45:18.900 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:18.938 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:18 +0000 (0:00:00.065) 0:00:46.922 ******* 2020-11-20T11:45:19.243 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T11:45:19.245 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:45:19.284 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:19 +0000 (0:00:00.345) 0:00:47.268 ******* 2020-11-20T11:45:19.418 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:45:19.458 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:19 +0000 (0:00:00.176) 0:00:47.444 ******* 2020-11-20T11:45:19.509 INFO:teuthology.task.ansible.out: 2020-11-20T11:45:19.511 INFO:teuthology.task.ansible.out:TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T11:45:19.554 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:19 +0000 (0:00:00.095) 0:00:47.539 ******* 2020-11-20T11:45:20.018 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:45:20.020 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:45:20.457 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:45:20.902 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:45:20.939 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:20 +0000 (0:00:01.385) 0:00:48.925 ******* 2020-11-20T11:45:21.128 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:45:21.165 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:21 +0000 (0:00:00.225) 0:00:49.150 ******* 2020-11-20T11:45:21.596 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:45:21.598 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:45:21.642 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T11:45:21.957 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} Friday 20 November 2020 11:45:21 +0000 (0:00:00.512) 0:00:49.662 ******* 2020-11-20T11:45:22.012 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T11:45:22.014 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi164.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:45:22.049 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:22 +0000 (0:00:00.372) 0:00:50.035 ******* 2020-11-20T11:45:22.164 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:45:22.166 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:45:22.424 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:45:22.426 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:45:22.464 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:22 +0000 (0:00:00.415) 0:00:50.450 ******* 2020-11-20T11:45:22.491 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:22.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:22 +0000 (0:00:00.060) 0:00:50.511 ******* 2020-11-20T11:45:22.542 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:45:22.544 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:45:22.565 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T11:45:22.567 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:45:22.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:22 +0000 (0:00:00.073) 0:00:50.585 ******* 2020-11-20T11:45:22.633 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:45:22.634 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:45:22.794 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T11:45:22.796 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:45:22.828 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:22 +0000 (0:00:00.229) 0:00:50.814 ******* 2020-11-20T11:45:22.866 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T11:45:22.867 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:22.877 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:22.888 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:22.899 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:22.934 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:22 +0000 (0:00:00.105) 0:00:50.920 ******* 2020-11-20T11:45:23.003 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:45:23.005 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:45:23.047 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:45:23.084 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:23 +0000 (0:00:00.150) 0:00:51.070 ******* 2020-11-20T11:45:23.269 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T11:45:23.270 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:45:23.303 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:23 +0000 (0:00:00.219) 0:00:51.289 ******* 2020-11-20T11:45:23.436 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi036.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:45:23.474 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:23 +0000 (0:00:00.170) 0:00:51.460 ******* 2020-11-20T11:45:23.662 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T11:45:23.664 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:45:23.712 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:23 +0000 (0:00:00.237) 0:00:51.697 ******* 2020-11-20T11:45:23.750 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:45:23.752 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:45:24.182 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:45:24.228 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:45:24.620 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:45:24.656 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:24 +0000 (0:00:00.944) 0:00:52.642 ******* 2020-11-20T11:45:24.663 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:45:24.686 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T11:45:24.688 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:24.720 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:24 +0000 (0:00:00.063) 0:00:52.706 ******* 2020-11-20T11:45:24.757 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T11:45:24.760 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:45:24.796 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:24 +0000 (0:00:00.076) 0:00:52.782 ******* 2020-11-20T11:45:24.994 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T11:45:24.996 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:45:25.142 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:25 +0000 (0:00:00.345) 0:00:53.127 ******* 2020-11-20T11:45:25.148 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:45:25.150 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:45:25.187 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:25 +0000 (0:00:00.045) 0:00:53.173 ******* 2020-11-20T11:45:25.194 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T11:45:25.195 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:25.206 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:25.207 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:25.217 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:25.218 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:25.253 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:25 +0000 (0:00:00.065) 0:00:53.239 ******* 2020-11-20T11:45:25.285 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:25 +0000 (0:00:00.031) 0:00:53.271 ******* 2020-11-20T11:45:25.291 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T11:45:25.293 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:45:25.327 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:25 +0000 (0:00:00.042) 0:00:53.313 ******* 2020-11-20T11:45:25.387 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:45:25.388 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:45:25.423 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:25 +0000 (0:00:00.095) 0:00:53.408 ******* 2020-11-20T11:45:25.450 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:45:25.452 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:25.486 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:25 +0000 (0:00:00.063) 0:00:53.472 ******* 2020-11-20T11:45:25.514 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T11:45:25.517 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:45:25.554 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:25 +0000 (0:00:00.068) 0:00:53.540 ******* 2020-11-20T11:45:25.594 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T11:45:25.595 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:25.605 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:25.617 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:25.628 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:25.667 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:25 +0000 (0:00:00.112) 0:00:53.653 ******* 2020-11-20T11:45:25.925 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T11:45:25.927 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:45:25.961 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:25 +0000 (0:00:00.293) 0:00:53.946 ******* 2020-11-20T11:45:26.394 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:45:26.396 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:45:26.428 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:26 +0000 (0:00:00.467) 0:00:54.413 ******* 2020-11-20T11:45:26.465 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:45:26.467 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:26.476 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:26.511 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:26 +0000 (0:00:00.082) 0:00:54.496 ******* 2020-11-20T11:45:26.710 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:45:26.712 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:45:26.744 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:26 +0000 (0:00:00.232) 0:00:54.729 ******* 2020-11-20T11:45:27.009 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:45:27.010 INFO:teuthology.task.ansible.out:fatal: [smithi164.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:45:27.043 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:27 +0000 (0:00:00.299) 0:00:55.029 ******* 2020-11-20T11:45:27.070 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:45:27.071 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:27.103 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:27 +0000 (0:00:00.060) 0:00:55.089 ******* 2020-11-20T11:45:27.538 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T11:45:27.540 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:45:27.574 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:27 +0000 (0:00:00.470) 0:00:55.559 ******* 2020-11-20T11:45:27.770 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:45:27.772 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:45:27.804 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:27 +0000 (0:00:00.230) 0:00:55.790 ******* 2020-11-20T11:45:27.831 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:45:27.833 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:27.866 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:27 +0000 (0:00:00.061) 0:00:55.852 ******* 2020-11-20T11:45:28.177 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:45:28.179 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:43:33 UTC", "ActiveEnterTimestampMonotonic": "15708524", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target time-sync.target -.mount network.target basic.target system.slice var-run.mount systemd-tmpfiles-setup.service systemd-journald.socket tmp.mount sysinit.target local-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:43:33 UTC", "AssertTimestampMonotonic": "15707263", "Before": "shutdown.target multi-user.target getty@tty1.service xdm.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:43:33 UTC", "ConditionTimestampMonotonic": "15707263", "ConfigurationDirectoryMode": " 2020-11-20T11:45:28.180 INFO:teuthology.task.ansible.out:0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "979", "ExecMainStartTimestamp": "Fri 2020-11-20 11:43:33 UTC", "ExecMainStartTimestampMonotonic": "15708482", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:43:33 UTC] ; stop_time=[n/a] ; pid=979 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:43:33 UTC", "InactiveExitTimestampMonotonic": "15708524", "InvocationID": "2c2901e5183e496a8706e21040c70d73", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T11:45:28.182 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "979", "MemoryAccounting": "yes", "MemoryCurrent": "1269760", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T11:45:28.183 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:43:33 UTC", "StateChangeTimestampMonotonic": "15708524", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:43:33 UTC", "WatchdogTimestampMonotonic": "15708523", "WatchdogUSec": "0"}} 2020-11-20T11:45:28.214 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:28 +0000 (0:00:00.348) 0:00:56.200 ******* 2020-11-20T11:45:28.285 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T11:45:28.287 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:45:28.322 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:28 +0000 (0:00:00.107) 0:00:56.307 ******* 2020-11-20T11:45:28.328 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:45:28.329 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:45:28.364 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:28 +0000 (0:00:00.042) 0:00:56.350 ******* 2020-11-20T11:45:28.391 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:45:28.392 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001733", "end": "2020-11-20 11:45:28.370180", "rc": 0, "start": "2020-11-20 11:45:28.368447", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T11:45:28.429 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:28 +0000 (0:00:00.064) 0:00:56.415 ******* 2020-11-20T11:45:28.464 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:28 +0000 (0:00:00.035) 0:00:56.450 ******* 2020-11-20T11:45:28.742 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:45:28.744 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:45:28.777 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:28 +0000 (0:00:00.312) 0:00:56.763 ******* 2020-11-20T11:45:28.815 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:45:28.817 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:28.850 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:28 +0000 (0:00:00.072) 0:00:56.836 ******* 2020-11-20T11:45:28.877 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T11:45:28.879 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:45:28.913 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:28 +0000 (0:00:00.062) 0:00:56.898 ******* 2020-11-20T11:45:29.035 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:45:29.037 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:45:29.071 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:29 +0000 (0:00:00.158) 0:00:57.057 ******* 2020-11-20T11:45:29.338 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:45:29.339 INFO:teuthology.task.ansible.out:fatal: [smithi188.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:45:29.373 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:29 +0000 (0:00:00.301) 0:00:57.358 ******* 2020-11-20T11:45:29.379 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:45:29.381 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:45:29.415 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:29 +0000 (0:00:00.042) 0:00:57.401 ******* 2020-11-20T11:45:29.422 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:45:29.424 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:29.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:29 +0000 (0:00:00.043) 0:00:57.445 ******* 2020-11-20T11:45:29.466 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:45:29.468 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:45:29.503 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:29 +0000 (0:00:00.043) 0:00:57.489 ******* 2020-11-20T11:45:29.715 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:45:29.717 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:45:29.759 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:29 +0000 (0:00:00.255) 0:00:57.744 ******* 2020-11-20T11:45:29.923 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T11:45:29.925 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:45:29.958 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:29 +0000 (0:00:00.199) 0:00:57.944 ******* 2020-11-20T11:45:30.038 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:45:30.040 INFO:teuthology.task.ansible.out:fatal: [smithi036.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:45:30.073 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:30 +0000 (0:00:00.114) 0:00:58.059 ******* 2020-11-20T11:45:30.100 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:45:30.101 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:45:30.133 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:30 +0000 (0:00:00.059) 0:00:58.118 ******* 2020-11-20T11:45:30.245 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:45:30.247 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:43:09 UTC", "ActiveEnterTimestampMonotonic": "15411489", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount basic.target -.mount local-fs.target network.target sysinit.target nss-lookup.target system.slice systemd-tmpfiles-setup.service var-run.mount time-sync.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:43:09 UTC", "AssertTimestampMonotonic": "15410440", "Before": "multi-user.target shutdown.target xdm.service getty@tty1.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:43:09 UTC", "ConditionTimestampMonotonic": "15410440", "ConfigurationDirectoryMode": " 2020-11-20T11:45:30.248 INFO:teuthology.task.ansible.out:0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "984", "ExecMainStartTimestamp": "Fri 2020-11-20 11:43:09 UTC", "ExecMainStartTimestampMonotonic": "15411441", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:43:09 UTC] ; stop_time=[n/a] ; pid=984 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:43:09 UTC", "InactiveExitTimestampMonotonic": "15411489", "InvocationID": "cfb2f249860243dfb677ca02f86a3fb8", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T11:45:30.250 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "984", "MemoryAccounting": "yes", "MemoryCurrent": "1404928", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T11:45:30.252 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:43:09 UTC", "StateChangeTimestampMonotonic": "15411489", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:43:09 UTC", "WatchdogTimestampMonotonic": "15411488", "WatchdogUSec": "0"}} 2020-11-20T11:45:30.285 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:30 +0000 (0:00:00.151) 0:00:58.270 ******* 2020-11-20T11:45:30.469 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T11:45:30.471 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001709", "end": "2020-11-20 11:45:30.442385", "rc": 0, "start": "2020-11-20 11:45:30.440676", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T11:45:30.504 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:30 +0000 (0:00:00.219) 0:00:58.490 ******* 2020-11-20T11:45:30.584 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T11:45:30.585 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:45:30.621 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:30 +0000 (0:00:00.117) 0:00:58.607 ******* 2020-11-20T11:45:30.849 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T11:45:30.851 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:45:30.886 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:30 +0000 (0:00:00.265) 0:00:58.872 ******* 2020-11-20T11:45:30.957 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:45:30.958 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:42:53 UTC", "ActiveEnterTimestampMonotonic": "16043181", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount tmp.mount network.target nss-lookup.target system.slice sysinit.target systemd-tmpfiles-setup.service systemd-journald.socket time-sync.target basic.target local-fs.target var-run.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:42:53 UTC", "AssertTimestampMonotonic": "16042275", "Before": "multi-user.target plymouth-quit.service xdm.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:42:53 UTC", "ConditionTimestampMonotonic": "16042275", "ConfigurationDirectoryMode": " 2020-11-20T11:45:30.960 INFO:teuthology.task.ansible.out:0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "984", "ExecMainStartTimestamp": "Fri 2020-11-20 11:42:53 UTC", "ExecMainStartTimestampMonotonic": "16043143", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:42:53 UTC] ; stop_time=[n/a] ; pid=984 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:42:53 UTC", "InactiveExitTimestampMonotonic": "16043181", "InvocationID": "869f562192fa4299a391f9e1d41252e7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T11:45:30.962 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "984", "MemoryAccounting": "yes", "MemoryCurrent": "1384448", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T11:45:30.963 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:42:53 UTC", "StateChangeTimestampMonotonic": "16043181", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:42:53 UTC", "WatchdogTimestampMonotonic": "16043180", "WatchdogUSec": "0"}} 2020-11-20T11:45:30.995 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:30 +0000 (0:00:00.108) 0:00:58.980 ******* 2020-11-20T11:45:31.180 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T11:45:31.182 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001771", "end": "2020-11-20 11:45:31.156179", "rc": 0, "start": "2020-11-20 11:45:31.154408", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T11:45:31.215 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:31 +0000 (0:00:00.220) 0:00:59.201 ******* 2020-11-20T11:45:32.906 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T11:45:33.064 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} Friday 20 November 2020 11:45:32 +0000 (0:00:01.726) 0:01:00.928 ******* 2020-11-20T11:45:33.332 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T11:45:33.335 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:45:33.371 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:33 +0000 (0:00:00.429) 0:01:01.357 ******* 2020-11-20T11:45:33.790 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T11:45:33.792 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:45:33.826 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:33 +0000 (0:00:00.455) 0:01:01.812 ******* 2020-11-20T11:45:34.138 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T11:45:34.140 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:45:34.173 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:34 +0000 (0:00:00.346) 0:01:02.159 ******* 2020-11-20T11:45:35.367 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T11:45:35.368 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:45:35.408 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:35 +0000 (0:00:01.235) 0:01:03.394 ******* 2020-11-20T11:45:36.061 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:45:36.114 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:36 +0000 (0:00:00.705) 0:01:04.100 ******* 2020-11-20T11:45:36.486 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T11:45:36.488 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:45:36.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:36 +0000 (0:00:00.409) 0:01:04.509 ******* 2020-11-20T11:45:37.175 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T11:45:37.177 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:45:37.210 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:37 +0000 (0:00:00.685) 0:01:05.195 ******* 2020-11-20T11:45:50.472 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.116040", "end": "2020-11-20 11:45:50.449090", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:45:34.333050", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:45:50.507 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:50 +0000 (0:00:13.296) 0:01:18.492 ******* 2020-11-20T11:45:50.948 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:45:50.950 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:45:50.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:50 +0000 (0:00:00.475) 0:01:18.968 ******* 2020-11-20T11:45:51.170 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:45:51.172 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.009719", "end": "2020-11-20 11:45:51.149664", "rc": 0, "start": "2020-11-20 11:45:51.139945", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:45:51.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:51 +0000 (0:00:00.231) 0:01:19.199 ******* 2020-11-20T11:45:51.401 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T11:45:51.402 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002078", "end": "2020-11-20 11:45:51.373518", "rc": 0, "start": "2020-11-20 11:45:51.371440", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:45:51.437 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:51 +0000 (0:00:00.223) 0:01:19.422 ******* 2020-11-20T11:45:52.543 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T11:45:52.545 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.220745", "end": "2020-11-20 11:45:52.517807", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:45:36.297062", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:45:52.587 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:52 +0000 (0:00:01.149) 0:01:20.572 ******* 2020-11-20T11:45:53.026 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:45:53.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:53 +0000 (0:00:00.473) 0:01:21.046 ******* 2020-11-20T11:45:53.311 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:45:53.312 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016307", "end": "2020-11-20 11:45:53.286391", "rc": 0, "start": "2020-11-20 11:45:53.270084", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:45:53.345 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:53 +0000 (0:00:00.284) 0:01:21.330 ******* 2020-11-20T11:45:53.530 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T11:45:53.532 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002113", "end": "2020-11-20 11:45:53.509222", "rc": 0, "start": "2020-11-20 11:45:53.507109", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:45:53.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:53 +0000 (0:00:00.219) 0:01:21.550 ******* 2020-11-20T11:45:54.178 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T11:45:54.180 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.775944", "end": "2020-11-20 11:45:54.148632", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:45:37.372688", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:45:54.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:54 +0000 (0:00:00.648) 0:01:22.199 ******* 2020-11-20T11:45:54.736 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:45:54.738 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:45:54.770 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:54 +0000 (0:00:00.557) 0:01:22.756 ******* 2020-11-20T11:45:54.989 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:45:54.990 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013612", "end": "2020-11-20 11:45:54.958130", "rc": 0, "start": "2020-11-20 11:45:54.944518", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:45:55.023 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:55 +0000 (0:00:00.252) 0:01:23.008 ******* 2020-11-20T11:45:55.216 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T11:45:55.217 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002003", "end": "2020-11-20 11:45:55.190336", "rc": 0, "start": "2020-11-20 11:45:55.188333", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:45:55.252 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:45:55 +0000 (0:00:00.229) 0:01:23.238 ******* 2020-11-20T11:46:07.685 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T11:46:07.687 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.061333", "end": "2020-11-20 11:46:07.659228", "rc": 0, "start": "2020-11-20 11:45:51.597895", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:46:07.720 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:07 +0000 (0:00:12.467) 0:01:35.706 ******* 2020-11-20T11:46:07.905 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:46:07.907 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:46:07.942 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:07 +0000 (0:00:00.221) 0:01:35.928 ******* 2020-11-20T11:46:07.970 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T11:46:07.972 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:08.009 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:08 +0000 (0:00:00.066) 0:01:35.995 ******* 2020-11-20T11:46:08.047 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:46:08.048 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:46:08.082 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:08 +0000 (0:00:00.073) 0:01:36.068 ******* 2020-11-20T11:46:08.101 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:46:08.103 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:08.135 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:08 +0000 (0:00:00.052) 0:01:36.121 ******* 2020-11-20T11:46:08.162 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:46:08.164 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:08.197 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:08 +0000 (0:00:00.061) 0:01:36.183 ******* 2020-11-20T11:46:08.256 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:46:08.257 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi164.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:46:08.293 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:08 +0000 (0:00:00.096) 0:01:36.279 ******* 2020-11-20T11:46:08.499 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:46:08.500 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:46:08.538 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:08 +0000 (0:00:00.244) 0:01:36.523 ******* 2020-11-20T11:46:09.026 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:46:09.028 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872768.5678074-36767984828538/source", "state": "file", "uid": 0} 2020-11-20T11:46:09.061 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:09 +0000 (0:00:00.523) 0:01:37.047 ******* 2020-11-20T11:46:09.088 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:46:09.090 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:46:09.123 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:09 +0000 (0:00:00.061) 0:01:37.109 ******* 2020-11-20T11:46:09.160 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:46:09.162 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:46:09.195 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:09 +0000 (0:00:00.071) 0:01:37.181 ******* 2020-11-20T11:46:09.235 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:46:09.237 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T11:46:09.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:09 +0000 (0:00:00.074) 0:01:37.255 ******* 2020-11-20T11:46:09.307 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T11:46:09.308 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:46:09.344 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:09 +0000 (0:00:00.074) 0:01:37.330 ******* 2020-11-20T11:46:09.528 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:46:09.530 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:46:09.567 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:09 +0000 (0:00:00.222) 0:01:37.553 ******* 2020-11-20T11:46:09.751 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T11:46:09.753 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:46:09.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:09 +0000 (0:00:00.218) 0:01:37.771 ******* 2020-11-20T11:46:09.812 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T11:46:09.814 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:09.846 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:09 +0000 (0:00:00.060) 0:01:37.832 ******* 2020-11-20T11:46:09.873 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T11:46:09.875 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:09.907 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:09 +0000 (0:00:00.060) 0:01:37.892 ******* 2020-11-20T11:46:09.913 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T11:46:09.914 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.150140", "end": "2020-11-20 11:46:09.877054", "rc": 0, "start": "2020-11-20 11:45:53.726914", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:46:09.950 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:09 +0000 (0:00:00.043) 0:01:37.936 ******* 2020-11-20T11:46:10.115 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:46:10.117 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:46:10.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:10 +0000 (0:00:00.200) 0:01:38.137 ******* 2020-11-20T11:46:10.158 INFO:teuthology.task.ansible.out: 2020-11-20T11:46:10.160 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:46:10.161 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:46:10.197 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:10 +0000 (0:00:00.046) 0:01:38.183 ******* 2020-11-20T11:46:10.235 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T11:46:10.237 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:10.270 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:10 +0000 (0:00:00.072) 0:01:38.255 ******* 2020-11-20T11:46:10.307 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:46:10.309 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:46:10.342 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:10 +0000 (0:00:00.072) 0:01:38.327 ******* 2020-11-20T11:46:10.369 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:46:10.371 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:10.403 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:10 +0000 (0:00:00.061) 0:01:38.388 ******* 2020-11-20T11:46:10.429 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:46:10.431 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:10.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:10 +0000 (0:00:00.060) 0:01:38.449 ******* 2020-11-20T11:46:10.521 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:46:10.523 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi188.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:46:10.560 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:10 +0000 (0:00:00.096) 0:01:38.546 ******* 2020-11-20T11:46:10.704 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:46:10.706 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:46:10.740 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:10 +0000 (0:00:00.179) 0:01:38.726 ******* 2020-11-20T11:46:10.757 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:46:10.759 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:46:10.792 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:10 +0000 (0:00:00.051) 0:01:38.777 ******* 2020-11-20T11:46:10.797 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T11:46:10.799 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi164"}, "changed": false} 2020-11-20T11:46:10.833 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:10 +0000 (0:00:00.041) 0:01:38.819 ******* 2020-11-20T11:46:11.263 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:46:11.265 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872770.819153-190114845171785/source", "state": "file", "uid": 0} 2020-11-20T11:46:11.297 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:11 +0000 (0:00:00.463) 0:01:39.283 ******* 2020-11-20T11:46:11.324 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:46:11.326 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:46:11.359 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:11 +0000 (0:00:00.061) 0:01:39.345 ******* 2020-11-20T11:46:11.396 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:46:11.398 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:46:11.431 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:11 +0000 (0:00:00.072) 0:01:39.417 ******* 2020-11-20T11:46:11.468 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:46:11.470 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T11:46:11.506 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:11 +0000 (0:00:00.074) 0:01:39.492 ******* 2020-11-20T11:46:11.543 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T11:46:11.546 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:46:11.578 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:11 +0000 (0:00:00.071) 0:01:39.563 ******* 2020-11-20T11:46:11.775 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:46:11.778 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:46:11.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:11 +0000 (0:00:00.231) 0:01:39.795 ******* 2020-11-20T11:46:11.847 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T11:46:11.849 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi164", "ansible_hostname": "smithi164", "ansible_nodename": "smithi164"}, "changed": false, "name": "smithi164"} 2020-11-20T11:46:11.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:11 +0000 (0:00:00.078) 0:01:39.874 ******* 2020-11-20T11:46:12.001 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T11:46:12.003 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:46:12.042 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.153) 0:01:40.027 ******* 2020-11-20T11:46:12.069 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T11:46:12.071 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:12.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.064) 0:01:40.092 ******* 2020-11-20T11:46:12.133 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T11:46:12.135 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:12.167 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.060) 0:01:40.153 ******* 2020-11-20T11:46:12.174 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.708463", "end": "2020-11-20 11:46:12.122924", "rc": 0, "start": "2020-11-20 11:45:55.414461", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:46:12.211 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.043) 0:01:40.197 ******* 2020-11-20T11:46:12.323 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T11:46:12.325 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T11:46:12.359 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.147) 0:01:40.344 ******* 2020-11-20T11:46:12.365 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:46:12.367 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:46:12.404 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.045) 0:01:40.390 ******* 2020-11-20T11:46:12.411 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:46:12.413 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:46:12.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.054) 0:01:40.445 ******* 2020-11-20T11:46:12.486 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T11:46:12.487 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:12.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.060) 0:01:40.505 ******* 2020-11-20T11:46:12.557 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:46:12.559 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:46:12.591 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.071) 0:01:40.577 ******* 2020-11-20T11:46:12.619 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:46:12.621 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:12.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.062) 0:01:40.639 ******* 2020-11-20T11:46:12.683 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:46:12.685 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:12.716 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.062) 0:01:40.702 ******* 2020-11-20T11:46:12.776 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:46:12.778 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:46:12.818 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.101) 0:01:40.803 ******* 2020-11-20T11:46:12.824 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T11:46:12.826 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:46:12.865 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.047) 0:01:40.851 ******* 2020-11-20T11:46:12.906 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:46:12.908 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:46:12.941 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.076) 0:01:40.927 ******* 2020-11-20T11:46:12.971 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T11:46:12.974 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi188"}, "changed": false} 2020-11-20T11:46:13.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:12 +0000 (0:00:00.063) 0:01:40.990 ******* 2020-11-20T11:46:13.032 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:46:13.034 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:46:13.072 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:13 +0000 (0:00:00.066) 0:01:41.057 ******* 2020-11-20T11:46:13.550 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi164.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:46:13.584 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:13 +0000 (0:00:00.512) 0:01:41.570 ******* 2020-11-20T11:46:13.590 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:46:13.592 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872773.0995474-66451776549665/source", "state": "file", "uid": 0} TASK [testnode : Set the system's hostname] ************************************ ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi188", "ansible_hostname": "smithi188", "ansible_nodename": "smithi188"}, "changed": false, "name": "smithi188"} 2020-11-20T11:46:13.628 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:13 +0000 (0:00:00.044) 0:01:41.614 ******* 2020-11-20T11:46:13.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:13 +0000 (0:00:00.033) 0:01:41.647 ******* 2020-11-20T11:46:13.667 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:46:13.669 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:46:13.704 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:13 +0000 (0:00:00.042) 0:01:41.690 ******* 2020-11-20T11:46:13.743 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:46:13.744 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:46:13.777 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:13 +0000 (0:00:00.072) 0:01:41.763 ******* 2020-11-20T11:46:13.815 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:46:13.817 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T11:46:13.851 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:13 +0000 (0:00:00.073) 0:01:41.837 ******* 2020-11-20T11:46:13.889 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T11:46:13.891 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:46:13.933 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:13 +0000 (0:00:00.081) 0:01:41.919 ******* 2020-11-20T11:46:14.035 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:46:14.037 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:46:14.078 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.144) 0:01:42.063 ******* 2020-11-20T11:46:14.106 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T11:46:14.108 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T11:46:14.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.086) 0:01:42.150 ******* 2020-11-20T11:46:14.173 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:46:14.175 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:46:14.209 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.044) 0:01:42.194 ******* 2020-11-20T11:46:14.281 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:46:14.283 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:46:14.316 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.107) 0:01:42.302 ******* 2020-11-20T11:46:14.407 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T11:46:14.408 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:46:14.443 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.126) 0:01:42.428 ******* 2020-11-20T11:46:14.471 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:14.514 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.071) 0:01:42.500 ******* 2020-11-20T11:46:14.521 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:46:14.522 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:46:14.555 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.041) 0:01:42.541 ******* 2020-11-20T11:46:14.562 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T11:46:14.564 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:14.597 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.042) 0:01:42.583 ******* 2020-11-20T11:46:14.616 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T11:46:14.618 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:46:14.657 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.059) 0:01:42.642 ******* 2020-11-20T11:46:14.759 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:46:14.760 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:46:14.795 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.138) 0:01:42.781 ******* 2020-11-20T11:46:14.812 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:46:14.814 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:46:14.847 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:14 +0000 (0:00:00.052) 0:01:42.833 ******* 2020-11-20T11:46:15.245 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T11:46:15.247 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:46:15.281 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:15 +0000 (0:00:00.433) 0:01:43.267 ******* 2020-11-20T11:46:15.288 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:46:15.290 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:46:15.325 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:15 +0000 (0:00:00.043) 0:01:43.310 ******* 2020-11-20T11:46:15.384 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:46:15.386 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:46:15.421 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:15 +0000 (0:00:00.095) 0:01:43.406 ******* 2020-11-20T11:46:15.448 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi036"}, "changed": false} 2020-11-20T11:46:15.482 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:15 +0000 (0:00:00.061) 0:01:43.467 ******* 2020-11-20T11:46:15.753 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:46:15.755 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:46:15.788 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:15 +0000 (0:00:00.306) 0:01:43.774 ******* 2020-11-20T11:46:15.794 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:46:15.795 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:46:15.830 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:15 +0000 (0:00:00.041) 0:01:43.816 ******* 2020-11-20T11:46:15.975 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:46:16.012 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:16 +0000 (0:00:00.182) 0:01:43.998 ******* 2020-11-20T11:46:16.071 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi036", "ansible_hostname": "smithi036", "ansible_nodename": "smithi036"}, "changed": false, "name": "smithi036"} 2020-11-20T11:46:16.106 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:16 +0000 (0:00:00.093) 0:01:44.092 ******* 2020-11-20T11:46:16.197 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:46:16.198 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:46:16.240 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:16 +0000 (0:00:00.134) 0:01:44.226 ******* 2020-11-20T11:46:16.448 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:46:16.449 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:46:16.488 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:16 +0000 (0:00:00.248) 0:01:44.474 ******* 2020-11-20T11:46:16.565 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T11:46:16.634 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:16 +0000 (0:00:00.141) 0:01:44.616 ******* 2020-11-20T11:46:16.994 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:46:17.029 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:17 +0000 (0:00:00.398) 0:01:45.014 ******* 2020-11-20T11:46:17.142 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T11:46:17.143 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:46:17.183 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:17 +0000 (0:00:00.154) 0:01:45.169 ******* 2020-11-20T11:46:17.524 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:46:17.527 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:46:17.560 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:17 +0000 (0:00:00.377) 0:01:45.546 ******* 2020-11-20T11:46:17.801 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T11:46:17.803 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:46:17.836 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:17 +0000 (0:00:00.276) 0:01:45.822 ******* 2020-11-20T11:46:18.024 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.992892", "end": "2020-11-20 11:46:17.986038", "rc": 0, "start": "2020-11-20 11:46:15.993146", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:46:18.054 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:18 +0000 (0:00:00.217) 0:01:46.040 ******* 2020-11-20T11:46:18.093 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:18.126 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:18 +0000 (0:00:00.071) 0:01:46.111 ******* 2020-11-20T11:46:18.313 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:46:18.315 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:46:18.348 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:18 +0000 (0:00:00.222) 0:01:46.334 ******* 2020-11-20T11:46:18.545 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:46:18.547 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:46:18.579 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:18 +0000 (0:00:00.230) 0:01:46.565 ******* 2020-11-20T11:46:18.617 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:46:18.619 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:46:18.658 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:18 +0000 (0:00:00.078) 0:01:46.643 ******* 2020-11-20T11:46:18.685 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:46:18.719 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:18 +0000 (0:00:00.061) 0:01:46.705 ******* 2020-11-20T11:46:18.746 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:46:18.781 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:18 +0000 (0:00:00.061) 0:01:46.767 ******* 2020-11-20T11:46:18.787 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:46:18.789 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:46:18.824 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:18 +0000 (0:00:00.043) 0:01:46.810 ******* 2020-11-20T11:46:18.831 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T11:46:18.833 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:18.870 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:18 +0000 (0:00:00.045) 0:01:46.856 ******* 2020-11-20T11:46:18.909 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:46:18.911 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:18.959 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:18 +0000 (0:00:00.088) 0:01:46.944 ******* 2020-11-20T11:46:18.986 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:46:18.988 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:19.020 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:19 +0000 (0:00:00.061) 0:01:47.006 ******* 2020-11-20T11:46:19.040 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:46:19.042 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:46:19.076 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:19 +0000 (0:00:00.055) 0:01:47.061 ******* 2020-11-20T11:46:19.084 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:19.122 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:19 +0000 (0:00:00.045) 0:01:47.107 ******* 2020-11-20T11:46:19.150 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:46:19.152 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:19.187 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:19 +0000 (0:00:00.065) 0:01:47.173 ******* 2020-11-20T11:46:19.217 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:19.255 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:19 +0000 (0:00:00.067) 0:01:47.241 ******* 2020-11-20T11:46:19.452 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi164.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006782", "end": "2020-11-20 11:46:19.426598", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:46:19.419816", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:46:19.491 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:19 +0000 (0:00:00.236) 0:01:47.477 ******* 2020-11-20T11:46:19.520 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:19.555 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:19 +0000 (0:00:00.063) 0:01:47.541 ******* 2020-11-20T11:46:19.562 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:46:19.563 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:46:19.598 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:19 +0000 (0:00:00.042) 0:01:47.584 ******* 2020-11-20T11:46:19.678 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:46:19.680 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.926150", "end": "2020-11-20 11:46:19.649263", "rc": 0, "start": "2020-11-20 11:46:17.723113", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:46:19.719 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:19 +0000 (0:00:00.121) 0:01:47.705 ******* 2020-11-20T11:46:19.757 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T11:46:19.758 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:19.791 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:19 +0000 (0:00:00.071) 0:01:47.776 ******* 2020-11-20T11:46:20.062 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:46:20.100 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:20 +0000 (0:00:00.309) 0:01:48.086 ******* 2020-11-20T11:46:20.255 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:46:20.257 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:46:20.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:20 +0000 (0:00:00.191) 0:01:48.277 ******* 2020-11-20T11:46:20.320 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:46:20.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:20 +0000 (0:00:00.062) 0:01:48.340 ******* 2020-11-20T11:46:20.382 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:46:20.416 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:20 +0000 (0:00:00.062) 0:01:48.402 ******* 2020-11-20T11:46:20.443 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T11:46:20.445 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:20.477 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:20 +0000 (0:00:00.060) 0:01:48.463 ******* 2020-11-20T11:46:20.517 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:46:20.519 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:20.553 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:20 +0000 (0:00:00.075) 0:01:48.539 ******* 2020-11-20T11:46:20.580 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:46:20.581 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:20.614 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:20 +0000 (0:00:00.061) 0:01:48.600 ******* 2020-11-20T11:46:20.643 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:46:20.645 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:20.677 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:20 +0000 (0:00:00.062) 0:01:48.663 ******* 2020-11-20T11:46:20.715 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:46:20.716 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:20.750 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:20 +0000 (0:00:00.072) 0:01:48.735 ******* 2020-11-20T11:46:20.787 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:46:20.789 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:20.822 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:20 +0000 (0:00:00.072) 0:01:48.808 ******* 2020-11-20T11:46:21.018 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:46:21.020 INFO:teuthology.task.ansible.out:fatal: [smithi188.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007100", "end": "2020-11-20 11:46:20.989686", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:46:20.982586", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:46:21.052 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:21 +0000 (0:00:00.230) 0:01:49.038 ******* 2020-11-20T11:46:21.089 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T11:46:21.091 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:21.127 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:21 +0000 (0:00:00.074) 0:01:49.113 ******* 2020-11-20T11:46:22.307 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:46:22.309 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.019087", "end": "2020-11-20 11:46:22.280834", "rc": 0, "start": "2020-11-20 11:46:20.261747", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:46:22.342 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:22 +0000 (0:00:01.215) 0:01:50.328 ******* 2020-11-20T11:46:22.375 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T11:46:22.377 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:22.428 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:22 +0000 (0:00:00.085) 0:01:50.413 ******* 2020-11-20T11:46:22.935 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi036.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:46:22.972 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:22 +0000 (0:00:00.544) 0:01:50.957 ******* 2020-11-20T11:46:22.999 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:46:23.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:23 +0000 (0:00:00.061) 0:01:51.019 ******* 2020-11-20T11:46:23.060 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:46:23.094 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:23 +0000 (0:00:00.061) 0:01:51.080 ******* 2020-11-20T11:46:23.122 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T11:46:23.123 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:23.156 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:23 +0000 (0:00:00.061) 0:01:51.141 ******* 2020-11-20T11:46:23.205 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:46:23.207 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:23.241 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:23 +0000 (0:00:00.085) 0:01:51.227 ******* 2020-11-20T11:46:23.302 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:46:23.304 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:23.346 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:23 +0000 (0:00:00.105) 0:01:51.332 ******* 2020-11-20T11:46:23.376 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:46:23.378 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:23.413 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:23 +0000 (0:00:00.066) 0:01:51.398 ******* 2020-11-20T11:46:23.463 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:23.496 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:23 +0000 (0:00:00.083) 0:01:51.482 ******* 2020-11-20T11:46:23.535 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:46:23.536 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:23.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:23 +0000 (0:00:00.076) 0:01:51.558 ******* 2020-11-20T11:46:23.781 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:46:23.783 INFO:teuthology.task.ansible.out:fatal: [smithi036.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007414", "end": "2020-11-20 11:46:23.756696", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:46:23.749282", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:46:23.823 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:23 +0000 (0:00:00.250) 0:01:51.809 ******* 2020-11-20T11:46:23.852 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T11:46:23.854 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:23.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:23 +0000 (0:00:00.064) 0:01:51.874 ******* 2020-11-20T11:46:26.150 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:46:26.182 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T11:46:26.192 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:26 +0000 (0:00:02.303) 0:01:54.178 ******* 2020-11-20T11:46:27.226 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T11:46:27.261 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:27 +0000 (0:00:01.069) 0:01:55.247 ******* 2020-11-20T11:46:30.392 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T11:46:30.427 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:30 +0000 (0:00:03.166) 0:01:58.413 ******* 2020-11-20T11:46:31.973 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:46:31.975 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T11:46:32.030 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:32 +0000 (0:00:01.602) 0:02:00.016 ******* 2020-11-20T11:46:32.974 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T11:46:33.009 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:33 +0000 (0:00:00.978) 0:02:00.995 ******* 2020-11-20T11:46:36.540 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T11:46:36.575 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:36 +0000 (0:00:03.565) 0:02:04.560 ******* 2020-11-20T11:46:38.841 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:46:38.841 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64"]} 2020-11-20T11:46:38.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:38 +0000 (0:00:02.314) 0:02:06.874 ******* 2020-11-20T11:46:39.885 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64"]} 2020-11-20T11:46:39.930 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:39 +0000 (0:00:01.041) 0:02:07.916 ******* 2020-11-20T11:46:41.347 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T11:46:41.349 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T11:46:41.382 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:41 +0000 (0:00:01.452) 0:02:09.368 ******* 2020-11-20T11:46:42.666 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T11:46:42.701 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:42 +0000 (0:00:01.318) 0:02:10.686 ******* 2020-11-20T11:46:43.741 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:46:43.743 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64"]} 2020-11-20T11:46:43.777 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:43 +0000 (0:00:01.076) 0:02:11.763 ******* 2020-11-20T11:46:43.795 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:46:43.797 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T11:46:43.830 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:43 +0000 (0:00:00.052) 0:02:11.816 ******* 2020-11-20T11:46:43.868 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:46:43.870 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:43.902 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:43 +0000 (0:00:00.072) 0:02:11.888 ******* 2020-11-20T11:46:44.196 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T11:46:44.198 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket polkit.service system.slice sysinit.target dbus.service basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ebtables.service shutdown.target ip6tables.service ipset.service nftables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2020-11-20T11:46:44.200 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2020-11-20T11:46:44.205 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2020-11-20T11:46:44.207 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T11:46:44.251 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:44 +0000 (0:00:00.347) 0:02:12.235 ******* 2020-11-20T11:46:44.555 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T11:46:44.557 INFO:teuthology.task.ansible.out:fatal: [smithi164.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:46:44.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:44 +0000 (0:00:00.349) 0:02:12.585 ******* 2020-11-20T11:46:45.138 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T11:46:45.174 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.575) 0:02:13.160 ******* 2020-11-20T11:46:45.176 INFO:teuthology.task.ansible.out: 2020-11-20T11:46:45.202 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:46:45.204 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:45.243 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.068) 0:02:13.229 ******* 2020-11-20T11:46:45.285 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T11:46:45.328 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.084) 0:02:13.314 ******* 2020-11-20T11:46:45.356 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T11:46:45.358 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:45.392 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.064) 0:02:13.378 ******* 2020-11-20T11:46:45.420 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T11:46:45.422 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:45.454 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.061) 0:02:13.440 ******* 2020-11-20T11:46:45.481 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T11:46:45.483 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:45.515 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.061) 0:02:13.501 ******* 2020-11-20T11:46:45.543 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T11:46:45.545 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:45.577 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.061) 0:02:13.563 ******* 2020-11-20T11:46:45.606 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T11:46:45.608 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice dbus.service polkit.service sysinit.target basic.target dbus.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "nftables.service shutdown.target ipset.service iptables.service ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2020-11-20T11:46:45.609 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2020-11-20T11:46:45.611 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2020-11-20T11:46:45.612 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:45.666 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.089) 0:02:13.652 ******* 2020-11-20T11:46:45.706 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.040) 0:02:13.692 ******* 2020-11-20T11:46:45.716 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T11:46:45.719 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:45.761 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.054) 0:02:13.746 ******* 2020-11-20T11:46:45.788 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:46:45.822 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.061) 0:02:13.807 ******* 2020-11-20T11:46:45.849 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T11:46:45.851 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:45.883 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.061) 0:02:13.869 ******* 2020-11-20T11:46:45.910 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T11:46:45.912 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:45.945 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:45 +0000 (0:00:00.061) 0:02:13.931 ******* 2020-11-20T11:46:45.983 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T11:46:45.985 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi188.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:46:46.018 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.073) 0:02:14.004 ******* 2020-11-20T11:46:46.025 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T11:46:46.027 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.061 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.042) 0:02:14.047 ******* 2020-11-20T11:46:46.099 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T11:46:46.101 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.142 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.080) 0:02:14.128 ******* 2020-11-20T11:46:46.169 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:46:46.204 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.061) 0:02:14.189 ******* 2020-11-20T11:46:46.241 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T11:46:46.243 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.071) 0:02:14.261 ******* 2020-11-20T11:46:46.281 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T11:46:46.283 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T11:46:46.321 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.045) 0:02:14.307 ******* 2020-11-20T11:46:46.327 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T11:46:46.329 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.044) 0:02:14.352 ******* 2020-11-20T11:46:46.373 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T11:46:46.374 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T11:46:46.410 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.044) 0:02:14.396 ******* 2020-11-20T11:46:46.444 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.033) 0:02:14.429 ******* 2020-11-20T11:46:46.449 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T11:46:46.450 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.041) 0:02:14.471 ******* 2020-11-20T11:46:46.492 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T11:46:46.494 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.529 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.044) 0:02:14.515 ******* 2020-11-20T11:46:46.536 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:46:46.538 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.043) 0:02:14.559 ******* 2020-11-20T11:46:46.580 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T11:46:46.581 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.618 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.044) 0:02:14.603 ******* 2020-11-20T11:46:46.625 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T11:46:46.627 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.662 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.043) 0:02:14.647 ******* 2020-11-20T11:46:46.668 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T11:46:46.669 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.706 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.044) 0:02:14.692 ******* 2020-11-20T11:46:46.712 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:46:46.714 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.767 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.060) 0:02:14.753 ******* 2020-11-20T11:46:46.777 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T11:46:46.779 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.816 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.049) 0:02:14.802 ******* 2020-11-20T11:46:46.866 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:46:46 +0000 (0:00:00.042) 0:02:14.845 ******* 2020-11-20T11:46:46.868 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.901 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.042) 0:02:14.887 ******* 2020-11-20T11:46:46.909 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T11:46:46.911 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:46.945 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.043) 0:02:14.931 ******* 2020-11-20T11:46:46.952 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:46:46.987 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:46 +0000 (0:00:00.042) 0:02:14.973 ******* 2020-11-20T11:46:46.996 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-20T11:46:46.999 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.029 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.041) 0:02:15.014 ******* 2020-11-20T11:46:47.042 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T11:46:47.044 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.076 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.047) 0:02:15.062 ******* 2020-11-20T11:46:47.082 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-20T11:46:47.084 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.118 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.041) 0:02:15.104 ******* 2020-11-20T11:46:47.124 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T11:46:47.126 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.159 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.040) 0:02:15.145 ******* 2020-11-20T11:46:47.165 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T11:46:47.167 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.202 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.042) 0:02:15.188 ******* 2020-11-20T11:46:47.210 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi188.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.212 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.247 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.044) 0:02:15.232 ******* 2020-11-20T11:46:47.253 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T11:46:47.255 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.288 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.041) 0:02:15.274 ******* 2020-11-20T11:46:47.295 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T11:46:47.297 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.043) 0:02:15.318 ******* 2020-11-20T11:46:47.338 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T11:46:47.340 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.375 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.043) 0:02:15.361 ******* 2020-11-20T11:46:47.388 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:46:47.424 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.048) 0:02:15.410 ******* 2020-11-20T11:46:47.430 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T11:46:47.432 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.467 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.042) 0:02:15.452 ******* 2020-11-20T11:46:47.473 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T11:46:47.475 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.508 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.041) 0:02:15.494 ******* 2020-11-20T11:46:47.515 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:46:47.516 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.550 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.041) 0:02:15.536 ******* 2020-11-20T11:46:47.557 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T11:46:47.559 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.041) 0:02:15.578 ******* 2020-11-20T11:46:47.600 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:46:47.601 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.636 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.044) 0:02:15.622 ******* 2020-11-20T11:46:47.644 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T11:46:47.646 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.681 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.044) 0:02:15.666 ******* 2020-11-20T11:46:47.687 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:46:47.689 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.723 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.042) 0:02:15.709 ******* 2020-11-20T11:46:47.730 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.766 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.042) 0:02:15.752 ******* 2020-11-20T11:46:47.773 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:46:47.774 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.819 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.051) 0:02:15.803 ******* 2020-11-20T11:46:47.824 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T11:46:47.826 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.042) 0:02:15.846 ******* 2020-11-20T11:46:47.866 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:46:47.869 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.907 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.046) 0:02:15.892 ******* 2020-11-20T11:46:47.913 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:46:47.914 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.948 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.041) 0:02:15.934 ******* 2020-11-20T11:46:47.954 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:46:47.956 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:47.990 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:47 +0000 (0:00:00.041) 0:02:15.975 ******* 2020-11-20T11:46:47.996 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-20T11:46:47.998 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.031 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.041) 0:02:16.017 ******* 2020-11-20T11:46:48.037 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:46:48.038 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.071 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.040) 0:02:16.057 ******* 2020-11-20T11:46:48.077 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T11:46:48.079 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.113 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.041) 0:02:16.099 ******* 2020-11-20T11:46:48.120 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.155 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.041) 0:02:16.141 ******* 2020-11-20T11:46:48.162 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.211 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.055) 0:02:16.196 ******* 2020-11-20T11:46:48.224 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:46:48.226 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.259 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.048) 0:02:16.245 ******* 2020-11-20T11:46:48.266 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.302 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.043) 0:02:16.288 ******* 2020-11-20T11:46:48.309 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:46:48.314 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.356 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.053) 0:02:16.342 ******* 2020-11-20T11:46:48.363 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T11:46:48.366 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.400 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.042) 0:02:16.385 ******* 2020-11-20T11:46:48.407 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:46:48.408 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.441 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.041) 0:02:16.427 ******* 2020-11-20T11:46:48.451 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.483 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.042) 0:02:16.469 ******* 2020-11-20T11:46:48.490 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:46:48.492 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.526 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.042) 0:02:16.512 ******* 2020-11-20T11:46:48.533 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T11:46:48.534 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.569 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.042) 0:02:16.555 ******* 2020-11-20T11:46:48.576 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.611 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.042) 0:02:16.597 ******* 2020-11-20T11:46:48.618 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T11:46:48.620 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.653 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.041) 0:02:16.639 ******* 2020-11-20T11:46:48.661 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.697 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.043) 0:02:16.682 ******* 2020-11-20T11:46:48.705 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.738 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.041) 0:02:16.724 ******* 2020-11-20T11:46:48.752 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.048) 0:02:16.772 ******* 2020-11-20T11:46:48.794 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.829 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.042) 0:02:16.815 ******* 2020-11-20T11:46:48.835 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:46:48.838 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.870 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.041) 0:02:16.856 ******* 2020-11-20T11:46:48.877 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:46:48.879 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.914 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.043) 0:02:16.899 ******* 2020-11-20T11:46:48.923 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.956 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.042) 0:02:16.942 ******* 2020-11-20T11:46:48.963 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:46:48.965 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:48.999 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:48 +0000 (0:00:00.042) 0:02:16.985 ******* 2020-11-20T11:46:49.006 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.041 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.041) 0:02:17.026 ******* 2020-11-20T11:46:49.048 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:46:49.049 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.084 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.043) 0:02:17.070 ******* 2020-11-20T11:46:49.119 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.034) 0:02:17.105 ******* 2020-11-20T11:46:49.126 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.131 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.043) 0:02:17.148 ******* 2020-11-20T11:46:49.195 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.032) 0:02:17.181 ******* 2020-11-20T11:46:49.202 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:46:49.204 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.245 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.044) 0:02:17.225 ******* 2020-11-20T11:46:49.247 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.284 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.044) 0:02:17.270 ******* 2020-11-20T11:46:49.290 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:46:49.292 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.326 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.041) 0:02:17.312 ******* 2020-11-20T11:46:49.332 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:46:49.333 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.041) 0:02:17.353 ******* 2020-11-20T11:46:49.374 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:46:49.375 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.411 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.043) 0:02:17.397 ******* 2020-11-20T11:46:49.418 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:46:49.420 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.458 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.047) 0:02:17.444 ******* 2020-11-20T11:46:49.470 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.508 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.049) 0:02:17.494 ******* 2020-11-20T11:46:49.516 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T11:46:49.517 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target basic.target dbus.service polkit.service system.slice dbus.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "nftables.service ip6tables.service iptables.service ipset.service shutdown.target ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2020-11-20T11:46:49.518 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2020-11-20T11:46:49.520 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2020-11-20T11:46:49.522 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.554 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.045) 0:02:17.539 ******* 2020-11-20T11:46:49.586 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.032) 0:02:17.572 ******* 2020-11-20T11:46:49.593 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:46:49.594 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.629 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.042) 0:02:17.615 ******* 2020-11-20T11:46:49.635 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:46:49.638 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.681 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.052) 0:02:17.667 ******* 2020-11-20T11:46:49.688 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.724 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.042) 0:02:17.709 ******* 2020-11-20T11:46:49.731 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.773 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.049) 0:02:17.759 ******* 2020-11-20T11:46:49.781 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:46:49.781 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.816 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.042) 0:02:17.802 ******* 2020-11-20T11:46:49.823 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T11:46:49.824 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.044) 0:02:17.846 ******* 2020-11-20T11:46:49.868 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:46:49.870 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi036.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:46:49.904 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.043) 0:02:17.890 ******* 2020-11-20T11:46:49.937 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.032) 0:02:17.922 ******* 2020-11-20T11:46:49.942 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T11:46:49.944 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:49.978 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:49 +0000 (0:00:00.042) 0:02:17.964 ******* 2020-11-20T11:46:49.985 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:46:49.987 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.020 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.041) 0:02:18.006 ******* 2020-11-20T11:46:50.028 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.075 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.054) 0:02:18.061 ******* 2020-11-20T11:46:50.082 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:46:50.084 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.129 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.053) 0:02:18.114 ******* 2020-11-20T11:46:50.137 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:46:50.139 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.173 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.044) 0:02:18.159 ******* 2020-11-20T11:46:50.179 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:46:50.181 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.215 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.042) 0:02:18.201 ******* 2020-11-20T11:46:50.222 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T11:46:50.224 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.258 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.043) 0:02:18.244 ******* 2020-11-20T11:46:50.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.032) 0:02:18.276 ******* 2020-11-20T11:46:50.299 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.341 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.050) 0:02:18.327 ******* 2020-11-20T11:46:50.381 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.039) 0:02:18.367 ******* 2020-11-20T11:46:50.388 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:46:50.390 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.425 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.043) 0:02:18.411 ******* 2020-11-20T11:46:50.456 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.031) 0:02:18.442 ******* 2020-11-20T11:46:50.463 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:46:50.465 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.499 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.042) 0:02:18.484 ******* 2020-11-20T11:46:50.534 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.035) 0:02:18.519 ******* 2020-11-20T11:46:50.540 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T11:46:50.540 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.541 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.576 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.042) 0:02:18.562 ******* 2020-11-20T11:46:50.608 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.031) 0:02:18.593 ******* 2020-11-20T11:46:50.613 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:46:50.615 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.649 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.041) 0:02:18.635 ******* 2020-11-20T11:46:50.681 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.031) 0:02:18.667 ******* 2020-11-20T11:46:50.687 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T11:46:50.688 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.722 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.041) 0:02:18.708 ******* 2020-11-20T11:46:50.754 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.031) 0:02:18.740 ******* 2020-11-20T11:46:50.760 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:46:50.761 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:46:50.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.041) 0:02:18.781 ******* 2020-11-20T11:46:50.827 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.031) 0:02:18.813 ******* 2020-11-20T11:46:50.833 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T11:46:50.835 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.869 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.041) 0:02:18.854 ******* 2020-11-20T11:46:50.907 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.038) 0:02:18.892 ******* 2020-11-20T11:46:50.915 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:46:50.917 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.953 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.044) 0:02:18.937 ******* 2020-11-20T11:46:50.984 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:50 +0000 (0:00:00.032) 0:02:18.970 ******* 2020-11-20T11:46:50.990 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T11:46:50.992 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:50.993 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.029 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.045) 0:02:19.015 ******* 2020-11-20T11:46:51.065 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.035) 0:02:19.051 ******* 2020-11-20T11:46:51.072 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-apt] ******************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.110 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.044) 0:02:19.096 ******* 2020-11-20T11:46:51.143 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.032) 0:02:19.128 ******* 2020-11-20T11:46:51.149 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T11:46:51.151 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:46:51.187 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.043) 0:02:19.172 ******* 2020-11-20T11:46:51.219 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.032) 0:02:19.205 ******* 2020-11-20T11:46:51.225 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:46:51.227 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.261 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.041) 0:02:19.246 ******* 2020-11-20T11:46:51.295 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.033) 0:02:19.280 ******* 2020-11-20T11:46:51.302 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-20T11:46:51.303 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.342 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.046) 0:02:19.327 ******* 2020-11-20T11:46:51.373 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.031) 0:02:19.359 ******* 2020-11-20T11:46:51.380 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:46:51.381 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.417 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.043) 0:02:19.402 ******* 2020-11-20T11:46:51.458 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.041) 0:02:19.443 ******* 2020-11-20T11:46:51.465 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T11:46:51.467 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.504 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.046) 0:02:19.490 ******* 2020-11-20T11:46:51.541 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.036) 0:02:19.526 ******* 2020-11-20T11:46:51.550 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:46:51.552 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.587 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.046) 0:02:19.572 ******* 2020-11-20T11:46:51.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.033) 0:02:19.606 ******* 2020-11-20T11:46:51.626 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:46:51.628 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Install packages] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.663 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.042) 0:02:19.648 ******* 2020-11-20T11:46:51.694 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.031) 0:02:19.680 ******* 2020-11-20T11:46:51.701 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T11:46:51.703 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.739 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.044) 0:02:19.724 ******* 2020-11-20T11:46:51.773 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.033) 0:02:19.758 ******* 2020-11-20T11:46:51.779 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T11:46:51.781 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} ok: [smithi164.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi164.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.781 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T11:46:51.782 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.782 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi164.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.782 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.823 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.050) 0:02:19.808 ******* 2020-11-20T11:46:51.830 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.830 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.832 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T11:46:51.834 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.871 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.048) 0:02:19.857 ******* 2020-11-20T11:46:51.904 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.032) 0:02:19.890 ******* 2020-11-20T11:46:51.910 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-20T11:46:51.911 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:51.946 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.041) 0:02:19.931 ******* 2020-11-20T11:46:51.952 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:46:51.954 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.002 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:51 +0000 (0:00:00.055) 0:02:19.987 ******* 2020-11-20T11:46:52.008 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-20T11:46:52.011 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.049 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.046) 0:02:20.034 ******* 2020-11-20T11:46:52.058 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:46:52.060 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.097 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.048) 0:02:20.083 ******* 2020-11-20T11:46:52.104 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T11:46:52.106 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T11:46:52.106 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003824", "end": "2020-11-20 11:46:52.051440", "rc": 0, "start": "2020-11-20 11:46:52.047616", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:46:52.142 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.044) 0:02:20.128 ******* 2020-11-20T11:46:52.177 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.035) 0:02:20.163 ******* 2020-11-20T11:46:52.184 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-20T11:46:52.186 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.044) 0:02:20.207 ******* 2020-11-20T11:46:52.253 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.031) 0:02:20.239 ******* 2020-11-20T11:46:52.259 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-20T11:46:52.261 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.296 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.041) 0:02:20.281 ******* 2020-11-20T11:46:52.331 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.036) 0:02:20.317 ******* 2020-11-20T11:46:52.338 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:46:52.340 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop apache2] ************************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.375 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.043) 0:02:20.360 ******* 2020-11-20T11:46:52.407 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.032) 0:02:20.393 ******* 2020-11-20T11:46:52.414 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T11:46:52.416 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.449 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.042) 0:02:20.435 ******* 2020-11-20T11:46:52.483 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.032) 0:02:20.468 ******* 2020-11-20T11:46:52.489 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T11:46:52.499 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.501 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.534 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.051) 0:02:20.520 ******* 2020-11-20T11:46:52.568 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.033) 0:02:20.554 ******* 2020-11-20T11:46:52.574 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T11:46:52.576 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.611 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.042) 0:02:20.597 ******* 2020-11-20T11:46:52.645 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.032) 0:02:20.629 ******* 2020-11-20T11:46:52.650 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T11:46:52.651 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.686 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.042) 0:02:20.672 ******* 2020-11-20T11:46:52.719 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.033) 0:02:20.705 ******* 2020-11-20T11:46:52.729 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T11:46:52.730 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.049) 0:02:20.754 ******* 2020-11-20T11:46:52.803 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.034) 0:02:20.789 ******* 2020-11-20T11:46:52.810 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T11:46:52.812 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.846 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.043) 0:02:20.832 ******* 2020-11-20T11:46:52.879 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.032) 0:02:20.865 ******* 2020-11-20T11:46:52.885 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:46:52.887 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.921 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.042) 0:02:20.907 ******* 2020-11-20T11:46:52.928 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T11:46:52.930 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:52.964 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:52 +0000 (0:00:00.042) 0:02:20.950 ******* 2020-11-20T11:46:52.972 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.007 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.042) 0:02:20.993 ******* 2020-11-20T11:46:53.014 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T11:46:53.015 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.051 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.044) 0:02:21.037 ******* 2020-11-20T11:46:53.090 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.055) 0:02:21.093 ******* 2020-11-20T11:46:53.118 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.163 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.055) 0:02:21.149 ******* 2020-11-20T11:46:53.176 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:46:53.179 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.214 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.051) 0:02:21.200 ******* 2020-11-20T11:46:53.216 INFO:teuthology.task.ansible.out: 2020-11-20T11:46:53.222 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T11:46:53.224 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.262 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.047) 0:02:21.248 ******* 2020-11-20T11:46:53.271 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:46:53.273 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.312 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.049) 0:02:21.298 ******* 2020-11-20T11:46:53.324 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:46:53.369 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.057) 0:02:21.355 ******* 2020-11-20T11:46:53.377 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:46:53.382 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.429 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.059) 0:02:21.415 ******* 2020-11-20T11:46:53.438 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi188.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.441 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T11:46:53.450 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.461 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:46:53.463 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi188.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.500 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.070) 0:02:21.486 ******* 2020-11-20T11:46:53.507 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.510 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.549 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.048) 0:02:21.535 ******* 2020-11-20T11:46:53.555 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:46:53.557 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.043) 0:02:21.578 ******* 2020-11-20T11:46:53.620 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:46:53.622 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.062) 0:02:21.640 ******* 2020-11-20T11:46:53.682 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:46:53.684 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.717 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.062) 0:02:21.702 ******* 2020-11-20T11:46:53.744 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T11:46:53.746 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003649", "end": "2020-11-20 11:46:53.722917", "rc": 0, "start": "2020-11-20 11:46:53.719268", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.063) 0:02:21.765 ******* 2020-11-20T11:46:53.817 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.037) 0:02:21.803 ******* 2020-11-20T11:46:53.823 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:46:53.824 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.043) 0:02:21.846 ******* 2020-11-20T11:46:53.867 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-20T11:46:53.869 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.908 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.047) 0:02:21.894 ******* 2020-11-20T11:46:53.916 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.952 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.043) 0:02:21.938 ******* 2020-11-20T11:46:53.958 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T11:46:53.960 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:53.993 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:53 +0000 (0:00:00.040) 0:02:21.978 ******* 2020-11-20T11:46:54.000 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:46:54.002 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.036 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.043) 0:02:22.022 ******* 2020-11-20T11:46:54.043 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T11:46:54.044 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.085 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.047) 0:02:22.069 ******* 2020-11-20T11:46:54.089 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:46:54.091 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.125 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.041) 0:02:22.111 ******* 2020-11-20T11:46:54.131 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T11:46:54.133 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.167 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.042) 0:02:22.153 ******* 2020-11-20T11:46:54.173 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:46:54.175 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.209 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.041) 0:02:22.195 ******* 2020-11-20T11:46:54.239 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:46:54.241 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.274 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.064) 0:02:22.260 ******* 2020-11-20T11:46:54.314 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:46:54.315 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.378 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.104) 0:02:22.364 ******* 2020-11-20T11:46:54.417 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:46:54.419 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.451 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.072) 0:02:22.437 ******* 2020-11-20T11:46:54.479 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T11:46:54.481 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.526 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.074) 0:02:22.512 ******* 2020-11-20T11:46:54.556 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T11:46:54.559 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.596 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.069) 0:02:22.582 ******* 2020-11-20T11:46:54.626 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.669 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.073) 0:02:22.655 ******* 2020-11-20T11:46:54.710 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:46:54.712 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.756 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.086) 0:02:22.741 ******* 2020-11-20T11:46:54.785 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.819 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.063) 0:02:22.804 ******* 2020-11-20T11:46:54.846 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:46:54.848 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.061) 0:02:22.866 ******* 2020-11-20T11:46:54.907 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T11:46:54.909 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:54.942 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.061) 0:02:22.928 ******* 2020-11-20T11:46:54.971 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.004 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:54 +0000 (0:00:00.061) 0:02:22.989 ******* 2020-11-20T11:46:55.033 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T11:46:55.036 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.073 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.069) 0:02:23.059 ******* 2020-11-20T11:46:55.101 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T11:46:55.102 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.135 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.062) 0:02:23.121 ******* 2020-11-20T11:46:55.168 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T11:46:55.170 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.202 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.067) 0:02:23.188 ******* 2020-11-20T11:46:55.210 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:46:55.248 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.045) 0:02:23.233 ******* 2020-11-20T11:46:55.255 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.292 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.044) 0:02:23.278 ******* 2020-11-20T11:46:55.301 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi164.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420969472, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153557, 'block_used': 12941551, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153557, "block_size": 4096, "block_total": 240095108, "block_used": 12941551, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420969472, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T11:46:55.339 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.047) 0:02:23.325 ******* 2020-11-20T11:46:55.346 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T11:46:55.348 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.387 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.047) 0:02:23.372 ******* 2020-11-20T11:46:55.415 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:46:55.456 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.069) 0:02:23.442 ******* 2020-11-20T11:46:55.506 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T11:46:55.508 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.533 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T11:46:55.542 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.547 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004987", "end": "2020-11-20 11:46:55.517905", "rc": 0, "start": "2020-11-20 11:46:55.512918", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:46:55.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.127) 0:02:23.569 ******* 2020-11-20T11:46:55.591 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T11:46:55.595 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.051) 0:02:23.620 ******* 2020-11-20T11:46:55.656 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi164.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420969472, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153557, 'block_used': 12941551, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153557, "block_size": 4096, "block_total": 240095108, "block_used": 12941551, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420969472, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.692 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.057) 0:02:23.678 ******* 2020-11-20T11:46:55.731 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:46:55.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.076) 0:02:23.754 ******* 2020-11-20T11:46:55.885 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T11:46:55.888 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.006516", "end": "2020-11-20 11:46:55.862153", "rc": 0, "start": "2020-11-20 11:46:55.855637", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:46:55.925 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.156) 0:02:23.911 ******* 2020-11-20T11:46:55.953 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-20T11:46:55.954 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:55.992 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:55 +0000 (0:00:00.067) 0:02:23.978 ******* 2020-11-20T11:46:56.031 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T11:46:56.033 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:56.071 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:56 +0000 (0:00:00.078) 0:02:24.057 ******* 2020-11-20T11:46:56.110 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T11:46:56.114 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:56.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:56 +0000 (0:00:00.079) 0:02:24.137 ******* 2020-11-20T11:46:56.180 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T11:46:56.182 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:56.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:56 +0000 (0:00:00.070) 0:02:24.207 ******* 2020-11-20T11:46:56.715 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T11:46:56.717 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:46:56.751 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:56 +0000 (0:00:00.529) 0:02:24.736 ******* 2020-11-20T11:46:56.789 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:46:56.790 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420977664, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153559, 'block_used': 12941549, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153559, "block_size": 4096, "block_total": 240095108, "block_used": 12941549, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420977664, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T11:46:56.824 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:56 +0000 (0:00:00.073) 0:02:24.810 ******* 2020-11-20T11:46:57.009 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T11:46:57.011 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005021", "end": "2020-11-20 11:46:56.984730", "rc": 0, "start": "2020-11-20 11:46:56.979709", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:46:57.044 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:57 +0000 (0:00:00.219) 0:02:25.030 ******* 2020-11-20T11:46:57.082 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T11:46:57.084 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420977664, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153559, 'block_used': 12941549, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153559, "block_size": 4096, "block_total": 240095108, "block_used": 12941549, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420977664, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:57.118 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:57 +0000 (0:00:00.073) 0:02:25.103 ******* 2020-11-20T11:46:57.145 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:46:57.179 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:57 +0000 (0:00:00.061) 0:02:25.165 ******* 2020-11-20T11:46:57.260 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:46:57.262 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CchlUdtgMDBFGAHcukrcPGohtrAIroyRK5'], 'uuids': ['dbf95ef3-e032-42bd-94d7-7cff25b03ae8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.258292", "end": "2020-11-20 11:46:57.218935", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CchlUdtgMDBFGAHcukrcPGohtrAIroyRK5"], "labels": [], "masters": [], "uuids": ["dbf95ef3-e032-42bd-94d7-7cff25b03ae8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:46:55.960643", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:46:58.533 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-W9Fefo-5xUa-4wc7-Y9Ly-0oky-maKj-Y58Lsc', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300H0400BGN', 'nvme-nvme.8086-43564654363233333030483034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.068762", "end": "2020-11-20 11:46:58.486327", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-W9Fefo-5xUa-4wc7-Y9Ly-0oky-maKj-Y58Lsc", "nvme-INTEL_SSDPEDMD400G4_CVFT623300H0400BGN", "nvme-nvme.8086-43564654363233333030483034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:46:57.417565", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:46:58.535 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:46:58.640 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhcv3tSz9zlTzsiHYGfKDTo6rHCaR6CwIE'], 'uuids': ['9bab3335-ffd5-4a51-a678-7877a37ae9fe'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.250943", "end": "2020-11-20 11:46:58.605733", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhcv3tSz9zlTzsiHYGfKDTo6rHCaR6CwIE"], "labels": [], "masters": [], "uuids": ["9bab3335-ffd5-4a51-a678-7877a37ae9fe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:46:57.354790", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:46:58.881 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:46:58.917 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:58 +0000 (0:00:01.737) 0:02:26.903 ******* 2020-11-20T11:46:58.955 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:46:58.957 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420916224, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153544, 'block_used': 12941564, 'inode_total': 61054976, 'inode_available': 60986950, 'inode_used': 68026, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153544, "block_size": 4096, "block_total": 240095108, "block_used": 12941564, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986950, "inode_total": 61054976, "inode_used": 68026, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420916224, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T11:46:58.991 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:58 +0000 (0:00:00.073) 0:02:26.976 ******* 2020-11-20T11:46:59.191 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T11:46:59.193 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005129", "end": "2020-11-20 11:46:59.167543", "rc": 0, "start": "2020-11-20 11:46:59.162414", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:46:59.225 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:59 +0000 (0:00:00.234) 0:02:27.211 ******* 2020-11-20T11:46:59.274 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T11:46:59.276 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420916224, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153544, 'block_used': 12941564, 'inode_total': 61054976, 'inode_available': 60986950, 'inode_used': 68026, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153544, "block_size": 4096, "block_total": 240095108, "block_used": 12941564, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986950, "inode_total": 61054976, "inode_used": 68026, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420916224, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:46:59.314 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:59 +0000 (0:00:00.087) 0:02:27.299 ******* 2020-11-20T11:46:59.341 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:46:59.380 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:46:59 +0000 (0:00:00.063) 0:02:27.363 ******* 2020-11-20T11:46:59.899 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:46:59.901 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-IxDBuY-f7Ff-ztcn-8Bpp-9gWT-2vTg-vpXeGu', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500MP400BGN', 'nvme-nvme.8086-504846543632303530304d5034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.068235", "end": "2020-11-20 11:46:59.860873", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-IxDBuY-f7Ff-ztcn-8Bpp-9gWT-2vTg-vpXeGu", "nvme-INTEL_SSDPEDMD400G4_PHFT620500MP400BGN", "nvme-nvme.8086-504846543632303530304d5034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:46:58.792638", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:46:59.903 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:46:59.922 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcyQ3QvG4YJsUsoOf9ZYwJPTu1zqSRF4XL'], 'uuids': ['7d23f449-29c8-4518-bab6-d15dce1ccb1d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.065249", "end": "2020-11-20 11:46:59.886644", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcyQ3QvG4YJsUsoOf9ZYwJPTu1zqSRF4XL"], "labels": [], "masters": [], "uuids": ["7d23f449-29c8-4518-bab6-d15dce1ccb1d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:46:58.821395", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:00.899 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1Op0ZTWi45cfTR7PqCBqMxd1VH9asVmGDk'], 'uuids': ['0bc4ee1c-248f-4b39-99dd-324eef2105c7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.300913", "end": "2020-11-20 11:47:00.865970", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1Op0ZTWi45cfTR7PqCBqMxd1VH9asVmGDk"], "labels": [], "masters": [], "uuids": ["0bc4ee1c-248f-4b39-99dd-324eef2105c7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:46:59.565057", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:01.173 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcAg1kaXXloR834w4KwpKnWPpGuuFLaZzI'], 'uuids': ['b9f3b189-a9d0-44fa-b00b-3fa6ece7b4d1'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.049655", "end": "2020-11-20 11:47:01.144312", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcAg1kaXXloR834w4KwpKnWPpGuuFLaZzI"], "labels": [], "masters": [], "uuids": ["b9f3b189-a9d0-44fa-b00b-3fa6ece7b4d1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:00.094657", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:01.328 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhggLbslYFN0af2i0CG29D5HqHXsGw1dvC'], 'uuids': ['14f5e0c7-5795-4510-b0d9-798287b055dc'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.198187", "end": "2020-11-20 11:47:01.290679", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhggLbslYFN0af2i0CG29D5HqHXsGw1dvC"], "labels": [], "masters": [], "uuids": ["14f5e0c7-5795-4510-b0d9-798287b055dc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:00.092492", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:02.175 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-9SgZWE-fFvi-jJNU-1c1i-CfQb-z2Ne-SodNf7', 'nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN', 'nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.075010", "end": "2020-11-20 11:47:02.135625", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-9SgZWE-fFvi-jJNU-1c1i-CfQb-z2Ne-SodNf7", "nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN", "nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:01.060615", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:47:02.177 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:02.430 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcY8sspdwhNqe6K0bdkonpCfS3CkjKt1oF'], 'uuids': ['d896adcd-3bf8-4470-b835-4fab0352a26f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.056433", "end": "2020-11-20 11:47:02.394572", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcY8sspdwhNqe6K0bdkonpCfS3CkjKt1oF"], "labels": [], "masters": [], "uuids": ["d896adcd-3bf8-4470-b835-4fab0352a26f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:01.338139", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:02.442 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTQ7', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTQ7', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTQ7', 'scsi-35000c5009293f07d', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTQ7', 'wwn-0x5000c5009293f07d'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTQ7', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293f07d', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTQ7-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTQ7-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTQ7-part1', 'scsi-35000c5009293f07d-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTQ7-part1', 'wwn-0x5000c5009293f07d-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTQ7", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTQ7", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTQ7", "scsi-35000c5009293f07d", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTQ7", "wwn-0x5000c5009293f07d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTQ7-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTQ7-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:47:02.444 INFO:teuthology.task.ansible.out:Z1W5XTQ7-part1", "scsi-35000c5009293f07d-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTQ7-part1", "wwn-0x5000c5009293f07d-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTQ7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293f07d"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:02.749 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhMUFBzUbGVFBniHOv1cqMHulXBIZNxQgf'], 'uuids': ['4d7de1bc-56ae-487d-b26f-2f0b195fd688'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.244579", "end": "2020-11-20 11:47:02.714340", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhMUFBzUbGVFBniHOv1cqMHulXBIZNxQgf"], "labels": [], "masters": [], "uuids": ["4d7de1bc-56ae-487d-b26f-2f0b195fd688"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:01.469761", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:03.407 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1O7xFgZ8Vj7qEEtQiMfd11haxchNv2aiVz'], 'uuids': ['93d488fe-ada2-4d69-aa3e-519016ad6ece'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.050423", "end": "2020-11-20 11:47:03.380393", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1O7xFgZ8Vj7qEEtQiMfd11haxchNv2aiVz"], "labels": [], "masters": [], "uuids": ["93d488fe-ada2-4d69-aa3e-519016ad6ece"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:02.329970", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:03.675 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569Cc9FayIxwxJQUqFdquxjfBQGj7XSdQ2cHM'], 'uuids': ['d10e2de7-b11b-445c-8ac3-7ba3267ad838'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.048772", "end": "2020-11-20 11:47:03.645999", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569Cc9FayIxwxJQUqFdquxjfBQGj7XSdQ2cHM"], "labels": [], "masters": [], "uuids": ["d10e2de7-b11b-445c-8ac3-7ba3267ad838"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:02.597227", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:03.716 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:03 +0000 (0:00:04.338) 0:02:31.702 ******* 2020-11-20T11:47:04.008 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhDKfwq0FhVrfbn3oa53CYM76jZDTmcdMT'], 'uuids': ['82b7bea3-59e1-4e54-a422-e6da4ea560b9'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.075029", "end": "2020-11-20 11:47:03.980055", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhDKfwq0FhVrfbn3oa53CYM76jZDTmcdMT"], "labels": [], "masters": [], "uuids": ["82b7bea3-59e1-4e54-a422-e6da4ea560b9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:02.905026", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:04.094 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:04.096 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CchlUdtgMDBFGAHcukrcPGohtrAIroyRK5'], 'uuids': ['dbf95ef3-e032-42bd-94d7-7cff25b03ae8'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.152520", "end": "2020-11-20 11:47:04.059729", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CchlUdtgMDBFGAHcukrcPGohtrAIroyRK5"], "labels": [], "masters": [], "uuids": ["dbf95ef3-e032-42bd-94d7-7cff25b03ae8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:03.907209", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14974 s, 770 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14974 s, 770 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:04.148 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:47:04.150 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTEX', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTEX', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTEX', 'scsi-35000c5009294703b', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTEX', 'wwn-0x5000c5009294703b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTEX', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009294703b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTEX-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTEX-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTEX-part1', 'scsi-35000c5009294703b-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTEX-part1', 'wwn-0x5000c5009294703b-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTEX", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTEX", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTEX", "scsi-35000c5009294703b", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTEX", "wwn-0x5000c5009294703b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTEX-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTEX-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:47:04.152 INFO:teuthology.task.ansible.out:Z1W5XTEX-part1", "scsi-35000c5009294703b-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTEX-part1", "wwn-0x5000c5009294703b-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTEX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009294703b"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:04.298 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:04.300 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-W9Fefo-5xUa-4wc7-Y9Ly-0oky-maKj-Y58Lsc', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300H0400BGN', 'nvme-nvme.8086-43564654363233333030483034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037670", "end": "2020-11-20 11:47:04.271886", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-W9Fefo-5xUa-4wc7-Y9Ly-0oky-maKj-Y58Lsc", "nvme-INTEL_SSDPEDMD400G4_CVFT623300H0400BGN", "nvme-nvme.8086-43564654363233333030483034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:04.234216", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0350831 s, 3.3 GB/s", "std 2020-11-20T11:47:04.302 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0350831 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:04.630 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcyQ3QvG4YJsUsoOf9ZYwJPTu1zqSRF4XL'], 'uuids': ['7d23f449-29c8-4518-bab6-d15dce1ccb1d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.142342", "end": "2020-11-20 11:47:04.602177", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcyQ3QvG4YJsUsoOf9ZYwJPTu1zqSRF4XL"], "labels": [], "masters": [], "uuids": ["7d23f449-29c8-4518-bab6-d15dce1ccb1d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:04.459835", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139714 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139714 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:04.653 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:47:04.656 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1OcIGb18nMUeTI9CEtqPVKbr6pws5Y8GZf'], 'uuids': ['2e491e49-44df-4cb6-bcd2-64ac8503bf40'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.042684", "end": "2020-11-20 11:47:04.622012", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1OcIGb18nMUeTI9CEtqPVKbr6pws5Y8GZf"], "labels": [], "masters": [], "uuids": ["2e491e49-44df-4cb6-bcd2-64ac8503bf40"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:03.579328", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:04.945 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:04.948 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcAg1kaXXloR834w4KwpKnWPpGuuFLaZzI'], 'uuids': ['b9f3b189-a9d0-44fa-b00b-3fa6ece7b4d1'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.140844", "end": "2020-11-20 11:47:04.915068", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcAg1kaXXloR834w4KwpKnWPpGuuFLaZzI"], "labels": [], "masters": [], "uuids": ["b9f3b189-a9d0-44fa-b00b-3fa6ece7b4d1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:04.774224", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138354 s, 834 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138354 s, 834 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:05.262 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcY8sspdwhNqe6K0bdkonpCfS3CkjKt1oF'], 'uuids': ['d896adcd-3bf8-4470-b835-4fab0352a26f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141317", "end": "2020-11-20 11:47:05.227536", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569CcY8sspdwhNqe6K0bdkonpCfS3CkjKt1oF"], "labels": [], "masters": [], "uuids": ["d896adcd-3bf8-4470-b835-4fab0352a26f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:05.086219", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138777 s, 831 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138777 s, 831 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:05.277 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTQ7', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTQ7', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTQ7', 'scsi-35000c5009293f07d', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTQ7', 'wwn-0x5000c5009293f07d'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTQ7', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293f07d', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTQ7-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTQ7-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTQ7-part1', 'scsi-35000c5009293f07d-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTQ7-part1', 'wwn-0x5000c5009293f07d-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTQ7", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTQ7", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTQ7", "scsi-35000c5009293f07d", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTQ7", "wwn-0x5000c5009293f07d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTQ7-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTQ7-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:47:05.285 INFO:teuthology.task.ansible.out:Z1W5XTQ7-part1", "scsi-35000c5009293f07d-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTQ7-part1", "wwn-0x5000c5009293f07d-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTQ7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293f07d"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:05.436 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:47:05.439 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhVOLomejNNJe0r65BVHLcXhmRTS0jvVvr'], 'uuids': ['49e0a3ca-dbc1-45f1-91d9-7cc57c3e9e18'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.097880", "end": "2020-11-20 11:47:05.397683", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhVOLomejNNJe0r65BVHLcXhmRTS0jvVvr"], "labels": [], "masters": [], "uuids": ["49e0a3ca-dbc1-45f1-91d9-7cc57c3e9e18"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:04.299803", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:05.480 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:05 +0000 (0:00:01.763) 0:02:33.465 ******* 2020-11-20T11:47:05.667 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569Cc9FayIxwxJQUqFdquxjfBQGj7XSdQ2cHM'], 'uuids': ['d10e2de7-b11b-445c-8ac3-7ba3267ad838'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.140349", "end": "2020-11-20 11:47:05.641424", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-IGLThQl70n0O3j7g4zS0Z0spvt0569Cc9FayIxwxJQUqFdquxjfBQGj7XSdQ2cHM"], "labels": [], "masters": [], "uuids": ["d10e2de7-b11b-445c-8ac3-7ba3267ad838"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:05.501075", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137814 s, 837 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137814 s, 837 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:05.710 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:05 +0000 (0:00:00.228) 0:02:33.694 ******* 2020-11-20T11:47:05.888 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:47:05.892 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1Om3BS5UnPabgESjzi448eB1XekX9MXnF0'], 'uuids': ['01c5dbf0-4b27-41af-81b3-d0637619e175'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.044572", "end": "2020-11-20 11:47:05.855014", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1Om3BS5UnPabgESjzi448eB1XekX9MXnF0"], "labels": [], "masters": [], "uuids": ["01c5dbf0-4b27-41af-81b3-d0637619e175"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:04.810442", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:47:05.901 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:05.905 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhcv3tSz9zlTzsiHYGfKDTo6rHCaR6CwIE'], 'uuids': ['9bab3335-ffd5-4a51-a678-7877a37ae9fe'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140259", "end": "2020-11-20 11:47:05.857288", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhcv3tSz9zlTzsiHYGfKDTo6rHCaR6CwIE"], "labels": [], "masters": [], "uuids": ["9bab3335-ffd5-4a51-a678-7877a37ae9fe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:05.717029", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137546 s, 839 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137546 s, 839 MB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4J2QS', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4J2QS', 'scsi-35000c500871b68bf', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4J2QS', 'wwn-0x5000c500871b68bf'], 'uuids': [ 2020-11-20T11:47:05.907 INFO:teuthology.task.ansible.out:], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4J2QS', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871b68bf', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4J2QS-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4J2QS-part1', 'scsi-35000c500871b68bf-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4J2QS-part1', 'wwn-0x5000c500871b68bf-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4J2QS", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4J2QS", "scsi-35000c500871b68bf", "scsi-SATA_ST1000NM0033-9ZM_Z1W4J2QS", "wwn-0x5000c500871b68bf"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4J2QS-part1", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4J2QS-part1", "scsi-35000c500871b68bf-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4J2QS-part1", "wwn-0x5000c500871b68bf-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95d 2020-11-20T11:47:05.908 INFO:teuthology.task.ansible.out:af886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2QS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b68bf"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:05.954 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T11:47:05.956 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.048628", "end": "2020-11-20 11:47:05.920958", "rc": 0, "start": "2020-11-20 11:47:05.872330", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:05.997 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:05 +0000 (0:00:00.284) 0:02:33.979 ******* 2020-11-20T11:47:06.154 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:06.155 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-IxDBuY-f7Ff-ztcn-8Bpp-9gWT-2vTg-vpXeGu', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500MP400BGN', 'nvme-nvme.8086-504846543632303530304d5034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037823", "end": "2020-11-20 11:47:06.099664", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-IxDBuY-f7Ff-ztcn-8Bpp-9gWT-2vTg-vpXeGu", "nvme-INTEL_SSDPEDMD400G4_PHFT620500MP400BGN", "nvme-nvme.8086-504846543632303530304d5034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:06.061841", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0351563 s, 3.3 GB/s", "std 2020-11-20T11:47:06.161 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0351563 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:06.256 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T11:47:06.259 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.039785", "end": "2020-11-20 11:47:06.228928", "rc": 0, "start": "2020-11-20 11:47:06.189143", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:06.287 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:06 +0000 (0:00:00.293) 0:02:34.272 ******* 2020-11-20T11:47:06.322 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:47:06.382 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:06 +0000 (0:00:00.090) 0:02:34.363 ******* 2020-11-20T11:47:06.408 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T11:47:06.410 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:06.445 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:06 +0000 (0:00:00.067) 0:02:34.430 ******* 2020-11-20T11:47:06.484 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T11:47:06.488 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhggLbslYFN0af2i0CG29D5HqHXsGw1dvC'], 'uuids': ['14f5e0c7-5795-4510-b0d9-798287b055dc'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.141677", "end": "2020-11-20 11:47:06.453741", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhggLbslYFN0af2i0CG29D5HqHXsGw1dvC"], "labels": [], "masters": [], "uuids": ["14f5e0c7-5795-4510-b0d9-798287b055dc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:06.312064", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139065 s, 829 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139065 s, 829 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:06.532 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:06 +0000 (0:00:00.084) 0:02:34.515 ******* 2020-11-20T11:47:06.559 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:06.604 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:06 +0000 (0:00:00.070) 0:02:34.586 ******* 2020-11-20T11:47:06.631 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:06.662 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:06 +0000 (0:00:00.060) 0:02:34.647 ******* 2020-11-20T11:47:06.808 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:06.811 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhMUFBzUbGVFBniHOv1cqMHulXBIZNxQgf'], 'uuids': ['4d7de1bc-56ae-487d-b26f-2f0b195fd688'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.140304", "end": "2020-11-20 11:47:06.781027", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhMUFBzUbGVFBniHOv1cqMHulXBIZNxQgf"], "labels": [], "masters": [], "uuids": ["4d7de1bc-56ae-487d-b26f-2f0b195fd688"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:06.640723", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137716 s, 838 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137716 s, 838 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:06.864 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi164.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:47:06.898 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:06 +0000 (0:00:00.237) 0:02:34.884 ******* 2020-11-20T11:47:06.950 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:47:06.952 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420969472, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153557, 'block_used': 12941551, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153557, "block_size": 4096, "block_total": 240095108, "block_used": 12941551, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420969472, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:07.002 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:06 +0000 (0:00:00.103) 0:02:34.987 ******* 2020-11-20T11:47:07.029 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:47:07.031 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:07.079 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:07 +0000 (0:00:00.076) 0:02:35.064 ******* 2020-11-20T11:47:07.110 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:47:07.111 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:07.148 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:07 +0000 (0:00:00.069) 0:02:35.134 ******* 2020-11-20T11:47:07.165 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhDKfwq0FhVrfbn3oa53CYM76jZDTmcdMT'], 'uuids': ['82b7bea3-59e1-4e54-a422-e6da4ea560b9'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.150691", "end": "2020-11-20 11:47:07.107032", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhDKfwq0FhVrfbn3oa53CYM76jZDTmcdMT"], "labels": [], "masters": [], "uuids": ["82b7bea3-59e1-4e54-a422-e6da4ea560b9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:06.956341", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148109 s, 779 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148109 s, 779 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi188.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTEX', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTEX', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTEX', 'scsi-35000c5009294703b', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTEX', 'wwn-0x5000c5009294703b'], 'uuids': [ 2020-11-20T11:47:07.171 INFO:teuthology.task.ansible.out:], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTEX', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009294703b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTEX-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTEX-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTEX-part1', 'scsi-35000c5009294703b-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XTEX-part1', 'wwn-0x5000c5009294703b-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTEX", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTEX", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTEX", "scsi-35000c5009294703b", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTEX", "wwn-0x5000c5009294703b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTEX-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XTEX-part1", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XTEX-part1", "scsi-35000c5009294703b-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XTEX-part1", "wwn-0x5000c5009294703b-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95d 2020-11-20T11:47:07.172 INFO:teuthology.task.ansible.out:af886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTEX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009294703b"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:07.176 INFO:teuthology.task.ansible.out: 2020-11-20T11:47:07.178 INFO:teuthology.task.ansible.out:TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1O5reONZJym40NOwW1gfwP3LHH5es0enba'], 'uuids': ['1009cd7f-8335-4a0c-9894-47ec1cf522e5'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.050585", "end": "2020-11-20 11:47:07.131784", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1O5reONZJym40NOwW1gfwP3LHH5es0enba"], "labels": [], "masters": [], "uuids": ["1009cd7f-8335-4a0c-9894-47ec1cf522e5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:06.081199", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk usi 2020-11-20T11:47:07.179 INFO:teuthology.task.ansible.out:ng fdisk or", "other utilities."]} 2020-11-20T11:47:07.226 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:07 +0000 (0:00:00.077) 0:02:35.212 ******* 2020-11-20T11:47:07.233 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:47:07.235 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:07.295 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:07 +0000 (0:00:00.068) 0:02:35.281 ******* 2020-11-20T11:47:07.326 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T11:47:07.328 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:07.363 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:07 +0000 (0:00:00.068) 0:02:35.349 ******* 2020-11-20T11:47:07.390 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:47:07.392 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:07.425 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:07 +0000 (0:00:00.061) 0:02:35.411 ******* 2020-11-20T11:47:07.452 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:07.453 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhVOLomejNNJe0r65BVHLcXhmRTS0jvVvr'], 'uuids': ['49e0a3ca-dbc1-45f1-91d9-7cc57c3e9e18'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.140208", "end": "2020-11-20 11:47:07.426890", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-yuk2AxBJjjboBYJbtXZz477EuWVzKnIhVOLomejNNJe0r65BVHLcXhmRTS0jvVvr"], "labels": [], "masters": [], "uuids": ["49e0a3ca-dbc1-45f1-91d9-7cc57c3e9e18"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:07.286682", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137604 s, 838 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137604 s, 838 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:07.461 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:07.494 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:07 +0000 (0:00:00.069) 0:02:35.480 ******* 2020-11-20T11:47:07.527 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:07 +0000 (0:00:00.032) 0:02:35.513 ******* 2020-11-20T11:47:07.599 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:07.601 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1Op0ZTWi45cfTR7PqCBqMxd1VH9asVmGDk'], 'uuids': ['0bc4ee1c-248f-4b39-99dd-324eef2105c7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138040", "end": "2020-11-20 11:47:07.568169", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1Op0ZTWi45cfTR7PqCBqMxd1VH9asVmGDk"], "labels": [], "masters": [], "uuids": ["0bc4ee1c-248f-4b39-99dd-324eef2105c7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:07.430129", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135186 s, 853 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135186 s, 853 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:07.753 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T11:47:07.755 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.048258", "end": "2020-11-20 11:47:07.729628", "rc": 0, "start": "2020-11-20 11:47:07.681370", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:07.790 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:07 +0000 (0:00:00.262) 0:02:35.775 ******* 2020-11-20T11:47:07.806 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:07.808 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-9SgZWE-fFvi-jJNU-1c1i-CfQb-z2Ne-SodNf7', 'nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN', 'nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036412", "end": "2020-11-20 11:47:07.780813", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-9SgZWE-fFvi-jJNU-1c1i-CfQb-z2Ne-SodNf7", "nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN", "nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:07.744401", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0337346 s, 3.4 GB/s", "std 2020-11-20T11:47:07.810 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0337346 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:08.035 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T11:47:08.037 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.058388", "end": "2020-11-20 11:47:08.005384", "rc": 0, "start": "2020-11-20 11:47:07.946996", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:08.086 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.296) 0:02:36.072 ******* 2020-11-20T11:47:08.093 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T11:47:08.095 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:47:08.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.047) 0:02:36.120 ******* 2020-11-20T11:47:08.143 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:47:08.145 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:08.146 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1O7xFgZ8Vj7qEEtQiMfd11haxchNv2aiVz'], 'uuids': ['93d488fe-ada2-4d69-aa3e-519016ad6ece'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139939", "end": "2020-11-20 11:47:08.099085", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1O7xFgZ8Vj7qEEtQiMfd11haxchNv2aiVz"], "labels": [], "masters": [], "uuids": ["93d488fe-ada2-4d69-aa3e-519016ad6ece"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:07.959146", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137183 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137183 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:08.198 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.064) 0:02:36.184 ******* 2020-11-20T11:47:08.226 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T11:47:08.228 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:08.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.065) 0:02:36.250 ******* 2020-11-20T11:47:08.304 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T11:47:08.305 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:08.351 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.087) 0:02:36.337 ******* 2020-11-20T11:47:08.378 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:47:08.380 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:08.422 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.071) 0:02:36.408 ******* 2020-11-20T11:47:08.444 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:08.445 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1OcIGb18nMUeTI9CEtqPVKbr6pws5Y8GZf'], 'uuids': ['2e491e49-44df-4cb6-bcd2-64ac8503bf40'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.136917", "end": "2020-11-20 11:47:08.410188", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1OcIGb18nMUeTI9CEtqPVKbr6pws5Y8GZf"], "labels": [], "masters": [], "uuids": ["2e491e49-44df-4cb6-bcd2-64ac8503bf40"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:08.273271", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13414 s, 860 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13414 s, 860 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:08.457 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T11:47:08.459 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:08.496 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.073) 0:02:36.481 ******* 2020-11-20T11:47:08.611 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:08.676 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:47:08.678 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:47:08.712 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.216) 0:02:36.698 ******* 2020-11-20T11:47:08.751 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:47:08.753 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420977664, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153559, 'block_used': 12941549, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153559, "block_size": 4096, "block_total": 240095108, "block_used": 12941549, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420977664, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:08.788 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.074) 0:02:36.773 ******* 2020-11-20T11:47:08.795 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:08.796 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1Om3BS5UnPabgESjzi448eB1XekX9MXnF0'], 'uuids': ['01c5dbf0-4b27-41af-81b3-d0637619e175'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.139084", "end": "2020-11-20 11:47:08.739729", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1Om3BS5UnPabgESjzi448eB1XekX9MXnF0"], "labels": [], "masters": [], "uuids": ["01c5dbf0-4b27-41af-81b3-d0637619e175"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:08.600645", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136442 s, 845 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136442 s, 845 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:08.798 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4J2QS', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4J2QS', 'scsi-35000c500871b68bf', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4J2QS', 'wwn-0x5000c500871b68bf'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4J2QS', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871b68bf', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4J2QS-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4J2QS-part1', 'scsi-35000c500871b68bf-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4J2QS-part1', 'wwn-0x5000c500871b68bf-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4J2QS", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4J2QS", "scsi-35000c500871b68bf", "scsi-SATA_ST1000NM0033-9ZM_Z1W4J2QS", "wwn-0x5000c500871b68bf"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4J2QS-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:47:08.800 INFO:teuthology.task.ansible.out:Z1W4J2QS-part1", "scsi-35000c500871b68bf-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4J2QS-part1", "wwn-0x5000c500871b68bf-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2QS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b68bf"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:08.822 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:47:08.823 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:08.858 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.070) 0:02:36.843 ******* 2020-11-20T11:47:08.884 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:47:08.886 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:08.925 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.065) 0:02:36.909 ******* 2020-11-20T11:47:08.931 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:47:08.932 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:08.955 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:47:08.957 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:08.990 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:08 +0000 (0:00:00.066) 0:02:36.976 ******* 2020-11-20T11:47:09.017 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T11:47:09.019 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:09.051 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:09 +0000 (0:00:00.060) 0:02:37.037 ******* 2020-11-20T11:47:09.079 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:09.112 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:09 +0000 (0:00:00.060) 0:02:37.097 ******* 2020-11-20T11:47:09.120 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:47:09.121 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1O5reONZJym40NOwW1gfwP3LHH5es0enba'], 'uuids': ['1009cd7f-8335-4a0c-9894-47ec1cf522e5'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.136542", "end": "2020-11-20 11:47:09.063313", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-rpPXewBU45N29USZMANm2CPV0g7ZwJ1O5reONZJym40NOwW1gfwP3LHH5es0enba"], "labels": [], "masters": [], "uuids": ["1009cd7f-8335-4a0c-9894-47ec1cf522e5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:47:08.926771", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.133895 s, 861 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.133895 s, 861 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:09.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:09 +0000 (0:00:00.052) 0:02:37.150 ******* 2020-11-20T11:47:09.170 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T11:47:09.172 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:09.208 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:09 +0000 (0:00:00.043) 0:02:37.193 ******* 2020-11-20T11:47:09.237 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:09.427 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T11:47:09.474 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.071049", "end": "2020-11-20 11:47:09.395396", "rc": 0, "start": "2020-11-20 11:47:09.324347", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Friday 20 November 2020 11:47:09 +0000 (0:00:00.266) 0:02:37.460 ******* 2020-11-20T11:47:09.560 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:09.712 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T11:47:09.713 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:47:09.753 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:09 +0000 (0:00:00.279) 0:02:37.739 ******* 2020-11-20T11:47:09.760 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T11:47:09.762 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048921", "end": "2020-11-20 11:47:09.718161", "rc": 0, "start": "2020-11-20 11:47:09.669240", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:09.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:09 +0000 (0:00:00.045) 0:02:37.785 ******* 2020-11-20T11:47:09.827 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:47:09.867 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:09 +0000 (0:00:00.067) 0:02:37.852 ******* 2020-11-20T11:47:09.896 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T11:47:09.897 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:09.932 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:09 +0000 (0:00:00.065) 0:02:37.918 ******* 2020-11-20T11:47:09.939 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:47:09.940 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:09.977 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:09 +0000 (0:00:00.045) 0:02:37.963 ******* 2020-11-20T11:47:09.984 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T11:47:09.986 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:10.029 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.052) 0:02:38.015 ******* 2020-11-20T11:47:10.057 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:47:10.059 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:10.094 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.064) 0:02:38.079 ******* 2020-11-20T11:47:10.121 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T11:47:10.123 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:10.169 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.075) 0:02:38.155 ******* 2020-11-20T11:47:10.179 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:47:10.181 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:47:10.181 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:47:10.232 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.063) 0:02:38.218 ******* 2020-11-20T11:47:10.358 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:47:10.397 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.164) 0:02:38.382 ******* 2020-11-20T11:47:10.459 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:47:10.469 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:10.472 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:10.521 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi036.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420916224, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153544, 'block_used': 12941564, 'inode_total': 61054976, 'inode_available': 60986950, 'inode_used': 68026, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153544, "block_size": 4096, "block_total": 240095108, "block_used": 12941564, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986950, "inode_total": 61054976, "inode_used": 68026, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420916224, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:10.564 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.168) 0:02:38.550 ******* 2020-11-20T11:47:10.596 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:10.638 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.072) 0:02:38.623 ******* 2020-11-20T11:47:10.666 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:10.669 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:10.705 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.067) 0:02:38.691 ******* 2020-11-20T11:47:10.755 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:10.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.090) 0:02:38.781 ******* 2020-11-20T11:47:10.813 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:47:10.815 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:10.825 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:10.859 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.063) 0:02:38.845 ******* 2020-11-20T11:47:10.876 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:47:10.878 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:10.888 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:10.923 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.063) 0:02:38.908 ******* 2020-11-20T11:47:10.952 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:10.987 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:10 +0000 (0:00:00.064) 0:02:38.973 ******* 2020-11-20T11:47:11.058 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi164.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:11.072 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:11.112 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:11 +0000 (0:00:00.124) 0:02:39.097 ******* 2020-11-20T11:47:11.144 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:11.330 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:47:11.385 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:11 +0000 (0:00:00.272) 0:02:39.370 ******* 2020-11-20T11:47:11.415 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:47:11.417 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:11.452 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:11 +0000 (0:00:00.067) 0:02:39.438 ******* 2020-11-20T11:47:11.459 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T11:47:11.462 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:47:11.513 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:11 +0000 (0:00:00.060) 0:02:39.498 ******* 2020-11-20T11:47:11.520 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:47:11.523 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:11.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:11 +0000 (0:00:00.046) 0:02:39.544 ******* 2020-11-20T11:47:11.753 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:47:11.754 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:47:11.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:11 +0000 (0:00:00.228) 0:02:39.773 ******* 2020-11-20T11:47:11.904 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:11.915 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:47:11.916 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:47:11.959 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:11 +0000 (0:00:00.171) 0:02:39.945 ******* 2020-11-20T11:47:12.011 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:47:12.014 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:12.177 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:12.263 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:47:12.264 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:12.349 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:47:12.350 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:12.520 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:12.558 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:12 +0000 (0:00:00.599) 0:02:40.544 ******* 2020-11-20T11:47:12.565 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:12.605 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:12 +0000 (0:00:00.046) 0:02:40.591 ******* 2020-11-20T11:47:12.613 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:12.653 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:12 +0000 (0:00:00.047) 0:02:40.638 ******* 2020-11-20T11:47:12.680 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:12.714 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:12 +0000 (0:00:00.061) 0:02:40.700 ******* 2020-11-20T11:47:12.741 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:47:12.743 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:12.777 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:12 +0000 (0:00:00.062) 0:02:40.763 ******* 2020-11-20T11:47:12.794 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T11:47:12.796 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:47:12.829 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:12 +0000 (0:00:00.052) 0:02:40.815 ******* 2020-11-20T11:47:12.835 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:47:12.837 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:12.871 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:12 +0000 (0:00:00.041) 0:02:40.857 ******* 2020-11-20T11:47:12.877 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:47:12.879 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:12.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:12 +0000 (0:00:00.044) 0:02:40.901 ******* 2020-11-20T11:47:12.923 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:12.958 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:12 +0000 (0:00:00.043) 0:02:40.944 ******* 2020-11-20T11:47:12.966 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:47:12.968 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:12.980 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.016 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.057) 0:02:41.002 ******* 2020-11-20T11:47:13.044 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T11:47:13.046 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.079 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.062) 0:02:41.064 ******* 2020-11-20T11:47:13.105 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T11:47:13.107 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.140 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.061) 0:02:41.126 ******* 2020-11-20T11:47:13.167 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:47:13.169 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.202 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.061) 0:02:41.187 ******* 2020-11-20T11:47:13.208 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:47:13.210 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:47:13.243 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.041) 0:02:41.229 ******* 2020-11-20T11:47:13.249 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-20T11:47:13.251 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.285 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.041) 0:02:41.271 ******* 2020-11-20T11:47:13.302 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:47:13.304 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:47:13.340 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.055) 0:02:41.326 ******* 2020-11-20T11:47:13.347 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T11:47:13.349 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.383 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.042) 0:02:41.369 ******* 2020-11-20T11:47:13.534 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:47:13.535 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:47:13.568 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.184) 0:02:41.553 ******* 2020-11-20T11:47:13.575 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T11:47:13.576 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:47:13.612 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.044) 0:02:41.597 ******* 2020-11-20T11:47:13.639 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:47:13.640 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.673 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.061) 0:02:41.659 ******* 2020-11-20T11:47:13.700 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T11:47:13.702 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.734 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.061) 0:02:41.720 ******* 2020-11-20T11:47:13.761 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:47:13.763 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.795 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.060) 0:02:41.781 ******* 2020-11-20T11:47:13.802 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:47:13.804 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:13.815 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:47:13.817 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.849 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.053) 0:02:41.835 ******* 2020-11-20T11:47:13.856 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T11:47:13.857 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T11:47:13.893 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.043) 0:02:41.879 ******* 2020-11-20T11:47:13.899 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-20T11:47:13.900 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:13.936 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.042) 0:02:41.921 ******* 2020-11-20T11:47:13.952 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:47:13.954 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:13.966 INFO:teuthology.task.ansible.out: 2020-11-20T11:47:13.968 INFO:teuthology.task.ansible.out:TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:14.001 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:13 +0000 (0:00:00.064) 0:02:41.986 ******* 2020-11-20T11:47:14.028 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:14.067 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.066) 0:02:42.053 ******* 2020-11-20T11:47:14.095 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T11:47:14.097 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:14.130 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.062) 0:02:42.115 ******* 2020-11-20T11:47:14.136 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:47:14.139 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:47:14.149 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:47:14.150 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:14.183 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.053) 0:02:42.169 ******* 2020-11-20T11:47:14.190 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:47:14.191 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:43:32 UTC", "ActiveEnterTimestampMonotonic": "15375386", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpdate.service systemd-journald.socket systemd-tmpfiles-setup.service sntp.service -.mount tmp.mount system.slice sysinit.target ntpd.service basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:43:31 UTC", "AssertTimestampMonotonic": "14217926", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:43:31 UTC", "ConditionTimestampMonotonic": "14217897", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGro 2020-11-20T11:47:14.193 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "895", "ExecMainStartTimestamp": "Fri 2020-11-20 11:43:32 UTC", "ExecMainStartTimestampMonotonic": "15323020", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:43:31 UTC] ; stop_time=[Fri 2020-11-20 11:43:32 UTC] ; pid=870 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:43:32 UTC] ; stop_time=[Fri 2020-11-20 11:43:32 UTC] ; pid=965 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:43:31 UTC", "InactiveExitTimestampMonotonic": "14274961", "InvocationID": "1ed396acd9dd471a99878c026dcd4beb", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "Limit 2020-11-20T11:47:14.195 INFO:teuthology.task.ansible.out:AS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "895", "MemoryAccounting": "yes", "MemoryCurrent": "3239936", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "R 2020-11-20T11:47:14.197 INFO:teuthology.task.ansible.out:equires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:43:32 UTC", "StateChangeTimestampMonotonic": "15375386", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:43:32 UTC", "WatchdogTimestampMonotonic": "15323031", "WatchdogUSec": "0"}} 2020-11-20T11:47:14.228 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.044) 0:02:42.214 ******* 2020-11-20T11:47:14.237 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-20T11:47:14.239 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:14.274 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.045) 0:02:42.259 ******* 2020-11-20T11:47:14.280 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:47:14.282 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:47:14.318 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.044) 0:02:42.303 ******* 2020-11-20T11:47:14.325 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T11:47:14.327 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:14.370 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.052) 0:02:42.356 ******* 2020-11-20T11:47:14.403 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.032) 0:02:42.389 ******* 2020-11-20T11:47:14.410 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:47:14.412 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:47:14.447 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.043) 0:02:42.433 ******* 2020-11-20T11:47:14.474 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T11:47:14.476 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:14.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.063) 0:02:42.496 ******* 2020-11-20T11:47:14.537 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:47:14.539 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:14.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.062) 0:02:42.559 ******* 2020-11-20T11:47:14.580 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T11:47:14.582 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:47:14.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.042) 0:02:42.601 ******* 2020-11-20T11:47:14.624 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T11:47:14.626 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:14.659 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.043) 0:02:42.645 ******* 2020-11-20T11:47:14.666 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:47:14.668 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:14.702 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.042) 0:02:42.688 ******* 2020-11-20T11:47:14.848 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:47:14.850 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:47:14.899 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.197) 0:02:42.885 ******* 2020-11-20T11:47:14.907 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T11:47:14.908 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T11:47:14.952 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:14 +0000 (0:00:00.052) 0:02:42.938 ******* 2020-11-20T11:47:15.275 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:47:15.276 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:43:10 UTC", "ActiveEnterTimestampMonotonic": "15537407", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sntp.service systemd-tmpfiles-setup.service ntpdate.service sysinit.target ntpd.service systemd-journald.socket tmp.mount basic.target system.slice -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:43:08 UTC", "AssertTimestampMonotonic": "14235571", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:43:08 UTC", "ConditionTimestampMonotonic": "14235535", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGro 2020-11-20T11:47:15.278 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "896", "ExecMainStartTimestamp": "Fri 2020-11-20 11:43:09 UTC", "ExecMainStartTimestampMonotonic": "15383101", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:43:08 UTC] ; stop_time=[Fri 2020-11-20 11:43:09 UTC] ; pid=885 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:43:09 UTC] ; stop_time=[Fri 2020-11-20 11:43:10 UTC] ; pid=982 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:43:08 UTC", "InactiveExitTimestampMonotonic": "14260487", "InvocationID": "dde4a88902e64387afddd5edbb4701a1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "Limit 2020-11-20T11:47:15.282 INFO:teuthology.task.ansible.out:AS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "896", "MemoryAccounting": "yes", "MemoryCurrent": "3121152", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "R 2020-11-20T11:47:15.285 INFO:teuthology.task.ansible.out:equires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:43:10 UTC", "StateChangeTimestampMonotonic": "15537407", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:43:09 UTC", "WatchdogTimestampMonotonic": "15383391", "WatchdogUSec": "0"}} 2020-11-20T11:47:15.314 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:15 +0000 (0:00:00.360) 0:02:43.298 ******* 2020-11-20T11:47:15.340 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:47:15.378 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:15 +0000 (0:00:00.064) 0:02:43.363 ******* 2020-11-20T11:47:15.405 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:47:15.407 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:47:15.441 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:15 +0000 (0:00:00.063) 0:02:43.427 ******* 2020-11-20T11:47:15.449 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:47:15.451 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:47:15.489 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:15 +0000 (0:00:00.047) 0:02:43.474 ******* 2020-11-20T11:47:15.518 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:15.555 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:15 +0000 (0:00:00.066) 0:02:43.541 ******* 2020-11-20T11:47:15.583 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:47:15.584 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:15.621 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:15 +0000 (0:00:00.065) 0:02:43.606 ******* 2020-11-20T11:47:15.659 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T11:47:15.661 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:15.699 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:15 +0000 (0:00:00.078) 0:02:43.685 ******* 2020-11-20T11:47:15.886 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:47:15.888 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:47:15.927 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:15 +0000 (0:00:00.228) 0:02:43.913 ******* 2020-11-20T11:47:15.992 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:47:15.993 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:47:16.028 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.100) 0:02:44.014 ******* 2020-11-20T11:47:16.411 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T11:47:16.412 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:47:16.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.430) 0:02:44.444 ******* 2020-11-20T11:47:16.486 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:47:16.488 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:16.521 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.062) 0:02:44.506 ******* 2020-11-20T11:47:16.528 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:47:16.530 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:47:16.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.044) 0:02:44.551 ******* 2020-11-20T11:47:16.571 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T11:47:16.573 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:16.608 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.042) 0:02:44.593 ******* 2020-11-20T11:47:16.636 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:47:16.638 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:16.670 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.061) 0:02:44.655 ******* 2020-11-20T11:47:16.698 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:47:16.700 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:16.732 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.062) 0:02:44.718 ******* 2020-11-20T11:47:16.739 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:47:16.741 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:47:16.775 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.043) 0:02:44.761 ******* 2020-11-20T11:47:16.782 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-20T11:47:16.784 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:16.817 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.042) 0:02:44.803 ******* 2020-11-20T11:47:16.824 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T11:47:16.827 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:16.865 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.047) 0:02:44.851 ******* 2020-11-20T11:47:16.874 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T11:47:16.876 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:16.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.049) 0:02:44.901 ******* 2020-11-20T11:47:16.917 INFO:teuthology.task.ansible.out: 2020-11-20T11:47:16.923 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:47:16.925 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:47:16.958 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.043) 0:02:44.944 ******* 2020-11-20T11:47:16.965 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T11:47:16.967 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:17.002 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:16 +0000 (0:00:00.042) 0:02:44.987 ******* 2020-11-20T11:47:17.029 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T11:47:17.032 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:17.075 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.073) 0:02:45.061 ******* 2020-11-20T11:47:17.100 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:47:17.102 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:17.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.059) 0:02:45.120 ******* 2020-11-20T11:47:17.151 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T11:47:17.154 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:47:17.186 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.051) 0:02:45.172 ******* 2020-11-20T11:47:17.193 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-20T11:47:17.195 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:17.228 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.041) 0:02:45.213 ******* 2020-11-20T11:47:17.236 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T11:47:17.237 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:17.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.041) 0:02:45.255 ******* 2020-11-20T11:47:17.276 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T11:47:17.278 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:17.313 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.043) 0:02:45.299 ******* 2020-11-20T11:47:17.320 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T11:47:17.321 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:47:17.355 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.042) 0:02:45.341 ******* 2020-11-20T11:47:17.383 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T11:47:17.385 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:17.419 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.063) 0:02:45.405 ******* 2020-11-20T11:47:17.606 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T11:47:17.607 INFO:teuthology.task.ansible.out:changed: [smithi164.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:47:17.646 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.226) 0:02:45.632 ******* 2020-11-20T11:47:17.668 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:47:17.671 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:47:17.706 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.059) 0:02:45.691 ******* 2020-11-20T11:47:17.734 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T11:47:17.736 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:17.770 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.064) 0:02:45.756 ******* 2020-11-20T11:47:17.797 INFO:teuthology.task.ansible.out: 2020-11-20T11:47:17.799 INFO:teuthology.task.ansible.out:TASK [testnode : Set interface] ************************************************ ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:47:17.832 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.062) 0:02:45.818 ******* 2020-11-20T11:47:17.839 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T11:47:17.843 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi164.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:47:17.876 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.043) 0:02:45.862 ******* 2020-11-20T11:47:17.909 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.032) 0:02:45.895 ******* 2020-11-20T11:47:17.937 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T11:47:17.938 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:17.971 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:17 +0000 (0:00:00.061) 0:02:45.956 ******* 2020-11-20T11:47:18.009 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:47:18.011 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.011 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi188.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:47:18.047 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.075) 0:02:46.032 ******* 2020-11-20T11:47:18.053 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:47:18.056 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.092 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.045) 0:02:46.078 ******* 2020-11-20T11:47:18.099 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.137 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.043) 0:02:46.121 ******* 2020-11-20T11:47:18.148 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T11:47:18.150 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.163 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi164.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.198 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.062) 0:02:46.183 ******* 2020-11-20T11:47:18.204 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T11:47:18.206 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:47:18.208 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:42:53 UTC", "ActiveEnterTimestampMonotonic": "15816328", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target system.slice systemd-tmpfiles-setup.service tmp.mount sntp.service sysinit.target -.mount ntpdate.service ntpd.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:42:51 UTC", "AssertTimestampMonotonic": "14205842", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:42:51 UTC", "ConditionTimestampMonotonic": "14205781", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGro 2020-11-20T11:47:18.210 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "822", "ExecMainStartTimestamp": "Fri 2020-11-20 11:42:53 UTC", "ExecMainStartTimestampMonotonic": "15672156", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:42:51 UTC] ; stop_time=[Fri 2020-11-20 11:42:53 UTC] ; pid=810 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:42:53 UTC] ; stop_time=[Fri 2020-11-20 11:42:53 UTC] ; pid=923 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:42:51 UTC", "InactiveExitTimestampMonotonic": "14406955", "InvocationID": "ebc5fc69e4774b1fb3902a7cf0ce4dcf", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "Limit 2020-11-20T11:47:18.211 INFO:teuthology.task.ansible.out:AS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "822", "MemoryAccounting": "yes", "MemoryCurrent": "3145728", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "R 2020-11-20T11:47:18.213 INFO:teuthology.task.ansible.out:equires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:42:53 UTC", "StateChangeTimestampMonotonic": "15816328", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:42:53 UTC", "WatchdogTimestampMonotonic": "15672178", "WatchdogUSec": "0"}} 2020-11-20T11:47:18.244 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.046) 0:02:46.230 ******* 2020-11-20T11:47:18.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.032) 0:02:46.262 ******* 2020-11-20T11:47:18.283 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:47:18.284 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:47:18.320 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.043) 0:02:46.305 ******* 2020-11-20T11:47:18.356 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.035) 0:02:46.341 ******* 2020-11-20T11:47:18.361 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T11:47:18.363 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:47:18.398 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.042) 0:02:46.383 ******* 2020-11-20T11:47:18.430 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.031) 0:02:46.415 ******* 2020-11-20T11:47:18.436 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.438 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.473 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.043) 0:02:46.459 ******* 2020-11-20T11:47:18.506 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.033) 0:02:46.492 ******* 2020-11-20T11:47:18.513 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:47:18.515 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.548 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.042) 0:02:46.534 ******* 2020-11-20T11:47:18.555 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T11:47:18.557 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.044) 0:02:46.578 ******* 2020-11-20T11:47:18.599 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T11:47:18.601 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.637 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.043) 0:02:46.621 ******* 2020-11-20T11:47:18.642 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T11:47:18.644 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.691 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.054) 0:02:46.676 ******* 2020-11-20T11:47:18.728 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.037) 0:02:46.714 ******* 2020-11-20T11:47:18.735 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-20T11:47:18.737 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.049) 0:02:46.764 ******* 2020-11-20T11:47:18.807 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:47:18.809 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.847 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.068) 0:02:46.833 ******* 2020-11-20T11:47:18.855 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:47:18.899 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.052) 0:02:46.885 ******* 2020-11-20T11:47:18.907 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-20T11:47:18.909 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:18.912 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi188.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:47:18.950 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.050) 0:02:46.936 ******* 2020-11-20T11:47:18.984 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:18 +0000 (0:00:00.033) 0:02:46.969 ******* 2020-11-20T11:47:18.990 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:47:18.992 INFO:teuthology.task.ansible.out:skipping: [smithi164.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.026 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.042) 0:02:47.012 ******* 2020-11-20T11:47:19.033 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T11:47:19.035 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.069 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.042) 0:02:47.055 ******* 2020-11-20T11:47:19.107 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:47:19.109 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.119 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.120 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.130 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.167 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.097) 0:02:47.153 ******* 2020-11-20T11:47:19.205 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T11:47:19.207 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi188.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.217 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.218 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.220 INFO:teuthology.task.ansible.out: 2020-11-20T11:47:19.231 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.233 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:47:19.235 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005539", "end": "2020-11-20 11:47:19.202547", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:47:19.197008", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:19.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.101) 0:02:47.255 ******* 2020-11-20T11:47:19.297 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.333 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.064) 0:02:47.319 ******* 2020-11-20T11:47:19.362 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.397 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.063) 0:02:47.382 ******* 2020-11-20T11:47:19.405 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:47:19.407 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:47:19.445 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.045) 0:02:47.428 ******* 2020-11-20T11:47:19.449 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:47:19.451 INFO:teuthology.task.ansible.out:ok: [smithi164.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003040", "end": "2020-11-20 11:47:19.371569", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:47:19.368529", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.489 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.046) 0:02:47.475 ******* 2020-11-20T11:47:19.516 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T11:47:19.518 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.551 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.061) 0:02:47.536 ******* 2020-11-20T11:47:19.578 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-20T11:47:19.580 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi164.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002787", "end": "2020-11-20 11:47:19.548349", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:47:19.545562", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:19.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.065) 0:02:47.602 ******* 2020-11-20T11:47:19.643 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:47:19.646 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.680 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.063) 0:02:47.666 ******* 2020-11-20T11:47:19.719 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-20T11:47:19.720 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.754 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.074) 0:02:47.740 ******* 2020-11-20T11:47:19.771 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi164.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.022115", "end": "2020-11-20 11:47:19.735744", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:47:19.713629", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:19.807 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.053) 0:02:47.793 ******* 2020-11-20T11:47:19.814 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:47:19.816 INFO:teuthology.task.ansible.out:skipping: [smithi188.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:19.851 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.044) 0:02:47.837 ******* 2020-11-20T11:47:19.857 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:47:19.894 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:19 +0000 (0:00:00.041) 0:02:47.879 ******* 2020-11-20T11:47:20.077 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi164.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:47:20.426 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:47:20.428 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:47:20.473 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:20 +0000 (0:00:00.579) 0:02:48.459 ******* 2020-11-20T11:47:20.504 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:20.539 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:20 +0000 (0:00:00.066) 0:02:48.525 ******* 2020-11-20T11:47:20.579 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:47:20.581 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-11-20T11:47:20.614 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:20 +0000 (0:00:00.074) 0:02:48.599 ******* 2020-11-20T11:47:20.802 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:47:20.836 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:20 +0000 (0:00:00.222) 0:02:48.822 ******* 2020-11-20T11:47:20.863 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T11:47:20.865 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:20.897 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:20 +0000 (0:00:00.061) 0:02:48.883 ******* 2020-11-20T11:47:20.925 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T11:47:20.927 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:47:20.961 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:20 +0000 (0:00:00.064) 0:02:48.947 ******* 2020-11-20T11:47:20.989 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T11:47:20.990 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.023 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.061) 0:02:49.008 ******* 2020-11-20T11:47:21.062 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:47:21.063 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.006461", "end": "2020-11-20 11:47:21.025556", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:47:20.019095", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:21.212 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:47:21.252 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.228) 0:02:49.237 ******* 2020-11-20T11:47:21.258 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi188.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003028", "end": "2020-11-20 11:47:21.215338", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:47:21.212310", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:21.421 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002787", "end": "2020-11-20 11:47:21.383677", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:47:21.380890", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:21.432 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-20T11:47:21.434 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:47:21.468 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.215) 0:02:49.453 ******* 2020-11-20T11:47:21.495 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.529 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.061) 0:02:49.514 ******* 2020-11-20T11:47:21.567 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:47:21.569 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.590 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.592 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.106) 0:02:49.620 ******* 2020-11-20T11:47:21.662 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:47:21.664 INFO:teuthology.task.ansible.out:ok: [smithi188.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.079736", "end": "2020-11-20 11:47:21.627935", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:47:21.548199", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:21.709 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.074) 0:02:49.695 ******* 2020-11-20T11:47:21.716 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T11:47:21.718 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.718 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.722 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result 2020-11-20T11:47:21.724 INFO:teuthology.task.ansible.out: was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.759 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.050) 0:02:49.745 ******* 2020-11-20T11:47:21.766 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:47:21.801 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.041) 0:02:49.787 ******* 2020-11-20T11:47:21.807 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:47:21.809 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.846 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.045) 0:02:49.832 ******* 2020-11-20T11:47:21.877 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-20T11:47:21.879 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.069) 0:02:49.902 ******* 2020-11-20T11:47:21.947 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:21.986 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:21 +0000 (0:00:00.070) 0:02:49.972 ******* 2020-11-20T11:47:21.994 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-20T11:47:21.996 INFO:teuthology.task.ansible.out:changed: [smithi188.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:47:22.041 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T11:47:22.043 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:22.083 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:22 +0000 (0:00:00.096) 0:02:50.069 ******* 2020-11-20T11:47:22.131 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:22.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:22 +0000 (0:00:00.081) 0:02:50.150 ******* 2020-11-20T11:47:22.195 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:22.241 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:22 +0000 (0:00:00.076) 0:02:50.227 ******* 2020-11-20T11:47:22.268 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-20T11:47:22.272 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:22.305 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:22 +0000 (0:00:00.063) 0:02:50.291 ******* 2020-11-20T11:47:22.332 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:47:22.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:22 +0000 (0:00:00.060) 0:02:50.351 ******* 2020-11-20T11:47:22.594 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:47:22.595 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005570", "end": "2020-11-20 11:47:22.553784", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:47:22.548214", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:22.783 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003125", "end": "2020-11-20 11:47:22.741993", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:47:22.738868", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:22.950 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002923", "end": "2020-11-20 11:47:22.919174", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:47:22.916251", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:23.151 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.024247", "end": "2020-11-20 11:47:23.114913", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:47:23.090666", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:47:23.186 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:23 +0000 (0:00:00.820) 0:02:51.172 ******* 2020-11-20T11:47:23.213 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:47:23.249 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:47:23 +0000 (0:00:00.060) 0:02:51.233 ******* 2020-11-20T11:47:23.442 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:47:23.537 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-11-20T11:47:23.541 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-11-20T11:47:23.544 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-11-20T11:47:23.546 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi036.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 smithi164.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 smithi188.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 Friday 20 November 2020 11:47:23 +0000 (0:00:00.297) 0:02:51.530 ******* =============================================================================== common : Register with subscription-manager. --------------------------- 14.54s common : nrpe - Remove SELinux policy package -------------------------- 13.30s common : nrpe - Load SELinux policy package ---------------------------- 12.47s testnode : Zap all non-root disks --------------------------------------- 4.34s testnode : Install packages --------------------------------------------- 2.31s testnode : Ensure ceph packages are not present. ------------------------ 2.30s common : nrpe - Install SELinux dependencies ---------------------------- 1.73s testnode : Ensure ceph dependency packages are not present. ------------- 1.60s Gathering Facts --------------------------------------------------------- 1.56s common : Enable necessary rhsm repos ------------------------------------ 1.28s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 0.95s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.82s ansible-managed : Add authorized keys for the ansible user. ------------- 0.77s common : Install Kerberos Packages (RedHat) ----------------------------- 0.76s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.76s Gathering Facts --------------------------------------------------------- 0.72s common : Get list of enabled RHSM repos -------------------------- 2020-11-20T11:47:23.548 INFO:teuthology.task.ansible.out:------- 0.72s users : Create all admin users with sudo access. ------------------------ 0.71s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 0.69s common : Install CA Cert from Satellite Server -------------------------- 0.68s 2020-11-20T11:47:23.882 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi164.front.sepia.ceph.com'), Remote(name='ubuntu@smithi036.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2020-11-20T11:47:23.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:47:23.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:47:23.954 INFO:teuthology.orchestra.run.smithi164:> true 2020-11-20T11:47:24.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:47:24.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:47:24.120 INFO:teuthology.orchestra.run.smithi036:> true 2020-11-20T11:47:24.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:47:24.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:47:24.288 INFO:teuthology.orchestra.run.smithi188:> true 2020-11-20T11:47:24.382 INFO:teuthology.run_tasks:Running task clock... 2020-11-20T11:47:24.394 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-20T11:47:24.395 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:47:24.395 INFO:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:47:24.432 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:47:24.448 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:47:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2020-11-20T11:47:24.497 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2020-11-20T11:47:24.512 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:47:24.526 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:47:24.584 INFO:teuthology.orchestra.run.smithi164.stderr:bash: ntpq: command not found 2020-11-20T11:47:24.587 INFO:teuthology.orchestra.run.smithi164.stdout:210 Number of sources = 4 2020-11-20T11:47:24.588 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:47:24.588 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2020-11-20T11:47:24.588 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.588 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.589 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.589 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.589 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:47:24.590 INFO:teuthology.orchestra.run.smithi036:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:47:24.627 INFO:teuthology.orchestra.run.smithi036.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:47:24.645 INFO:teuthology.orchestra.run.smithi036.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:47:24.679 INFO:teuthology.orchestra.run.smithi036.stderr:sudo: ntpd: command not found 2020-11-20T11:47:24.690 INFO:teuthology.orchestra.run.smithi036.stdout:506 Cannot talk to daemon 2020-11-20T11:47:24.706 INFO:teuthology.orchestra.run.smithi036.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:47:24.721 INFO:teuthology.orchestra.run.smithi036.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:47:24.790 INFO:teuthology.orchestra.run.smithi036.stderr:bash: ntpq: command not found 2020-11-20T11:47:24.793 INFO:teuthology.orchestra.run.smithi036.stdout:210 Number of sources = 4 2020-11-20T11:47:24.793 INFO:teuthology.orchestra.run.smithi036.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:47:24.794 INFO:teuthology.orchestra.run.smithi036.stdout:=============================================================================== 2020-11-20T11:47:24.794 INFO:teuthology.orchestra.run.smithi036.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.794 INFO:teuthology.orchestra.run.smithi036.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.794 INFO:teuthology.orchestra.run.smithi036.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.795 INFO:teuthology.orchestra.run.smithi036.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.795 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:47:24.795 INFO:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:47:24.833 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:47:24.849 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:47:24.887 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2020-11-20T11:47:24.898 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2020-11-20T11:47:24.913 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:47:24.927 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:47:24.991 INFO:teuthology.orchestra.run.smithi188.stderr:bash: ntpq: command not found 2020-11-20T11:47:24.993 INFO:teuthology.orchestra.run.smithi188.stdout:210 Number of sources = 4 2020-11-20T11:47:24.994 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:47:24.994 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2020-11-20T11:47:24.994 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.994 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.994 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.995 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:47:24.995 INFO:teuthology.run_tasks:Running task install... 2020-11-20T11:47:25.006 DEBUG:teuthology.task.install:project ceph 2020-11-20T11:47:25.006 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}} 2020-11-20T11:47:25.007 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'} 2020-11-20T11:47:25.007 INFO:teuthology.task.install:Using flavor: basic 2020-11-20T11:47:25.014 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-20T11:47:25.014 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-11-20T11:47:25.015 INFO:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2020-11-20T11:47:25.050 INFO:teuthology.orchestra.run.smithi164.stdout:RedHatEnterprise 2020-11-20T11:47:25.052 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:47:25.052 INFO:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2020-11-20T11:47:25.053 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:47:25.055 INFO:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2020-11-20T11:47:25.093 INFO:teuthology.orchestra.run.smithi036.stdout:RedHatEnterprise 2020-11-20T11:47:25.094 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:47:25.094 INFO:teuthology.orchestra.run.smithi188:> sudo lsb_release -is 2020-11-20T11:47:25.095 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:47:25.095 INFO:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2020-11-20T11:47:25.125 INFO:teuthology.orchestra.run.smithi164.stdout:RedHatEnterprise 2020-11-20T11:47:25.126 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:47:25.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:47:25.131 INFO:teuthology.orchestra.run.smithi188.stdout:RedHatEnterprise 2020-11-20T11:47:25.131 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:47:25.131 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:47:25.132 INFO:teuthology.orchestra.run.smithi188:> sudo lsb_release -is 2020-11-20T11:47:25.170 INFO:teuthology.orchestra.run.smithi036.stdout:RedHatEnterprise 2020-11-20T11:47:25.171 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:47:25.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:47:25.209 INFO:teuthology.orchestra.run.smithi188.stdout:RedHatEnterprise 2020-11-20T11:47:25.209 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:47:25.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:47:25.297 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:47:25.298 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:47:25.343 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:47:25.343 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:47:25.403 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:47:25.403 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:47:25.446 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:47:25.447 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:47:25.448 INFO:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:47:25.462 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:47:25.473 INFO:teuthology.orchestra.run.smithi164.stderr:1+1 records in 2020-11-20T11:47:25.473 INFO:teuthology.orchestra.run.smithi164.stderr:1+1 records out 2020-11-20T11:47:25.474 INFO:teuthology.orchestra.run.smithi164.stderr:676 bytes copied, 4.1515e-05 s, 16.3 MB/s 2020-11-20T11:47:25.475 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:47:25.475 INFO:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:47:25.479 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:47:25.480 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:47:25.480 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:47:25.496 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:47:25.507 INFO:teuthology.orchestra.run.smithi036.stderr:1+1 records in 2020-11-20T11:47:25.508 INFO:teuthology.orchestra.run.smithi036.stderr:1+1 records out 2020-11-20T11:47:25.508 INFO:teuthology.orchestra.run.smithi036.stderr:676 bytes copied, 4.8716e-05 s, 13.9 MB/s 2020-11-20T11:47:25.509 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:47:25.509 INFO:teuthology.orchestra.run.smithi036:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:47:25.529 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:47:25.530 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:47:25.530 INFO:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:47:25.541 INFO:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:47:25.544 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:47:25.553 INFO:teuthology.orchestra.run.smithi188.stderr:1+1 records in 2020-11-20T11:47:25.554 INFO:teuthology.orchestra.run.smithi188.stderr:1+1 records out 2020-11-20T11:47:25.554 INFO:teuthology.orchestra.run.smithi188.stderr:676 bytes copied, 3.6604e-05 s, 18.5 MB/s 2020-11-20T11:47:25.555 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:47:25.555 INFO:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:47:25.577 INFO:teuthology.orchestra.run.smithi036:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:47:25.617 INFO:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:47:25.620 INFO:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:47:25.656 INFO:teuthology.orchestra.run.smithi036:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:47:25.684 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2020-11-20T11:47:25.684 INFO:teuthology.orchestra.run.smithi164:> sudo yum clean all 2020-11-20T11:47:25.693 INFO:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:47:25.725 INFO:teuthology.orchestra.run.smithi036.stdout:check_obsoletes = 1 2020-11-20T11:47:25.726 INFO:teuthology.orchestra.run.smithi036:> sudo yum clean all 2020-11-20T11:47:25.756 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2020-11-20T11:47:25.757 INFO:teuthology.orchestra.run.smithi188:> sudo yum clean all 2020-11-20T11:47:25.992 INFO:teuthology.orchestra.run.smithi164.stdout:Updating Subscription Management repositories. 2020-11-20T11:47:26.049 INFO:teuthology.orchestra.run.smithi036.stdout:Updating Subscription Management repositories. 2020-11-20T11:47:26.059 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2020-11-20T11:47:26.276 INFO:teuthology.orchestra.run.smithi164.stdout:38 files removed 2020-11-20T11:47:26.313 INFO:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:47:26.346 INFO:teuthology.orchestra.run.smithi036.stdout:38 files removed 2020-11-20T11:47:26.375 INFO:teuthology.orchestra.run.smithi188.stdout:38 files removed 2020-11-20T11:47:26.380 INFO:teuthology.orchestra.run.smithi036:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:47:26.411 INFO:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:47:26.575 INFO:teuthology.orchestra.run.smithi164.stdout:Updating Subscription Management repositories. 2020-11-20T11:47:26.661 INFO:teuthology.orchestra.run.smithi036.stdout:Updating Subscription Management repositories. 2020-11-20T11:47:26.676 INFO:teuthology.orchestra.run.smithi188.stdout:Updating Subscription Management repositories. 2020-11-20T11:47:27.211 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 291 kB/s | 72 kB 00:00 2020-11-20T11:47:27.305 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 297 kB/s | 72 kB 00:00 2020-11-20T11:47:27.320 INFO:teuthology.orchestra.run.smithi036.stdout:ceph packages for x86_64 294 kB/s | 72 kB 00:00 2020-11-20T11:47:27.444 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 73 kB/s | 15 kB 00:00 2020-11-20T11:47:27.538 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 73 kB/s | 15 kB 00:00 2020-11-20T11:47:27.555 INFO:teuthology.orchestra.run.smithi036.stdout:ceph noarch packages 73 kB/s | 15 kB 00:00 2020-11-20T11:47:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2020-11-20T11:47:27.763 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2020-11-20T11:47:27.783 INFO:teuthology.orchestra.run.smithi036.stdout:ceph source packages 6.9 kB/s | 1.4 kB 00:00 2020-11-20T11:47:28.014 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 26 MB/s | 8.3 MB 00:00 2020-11-20T11:47:28.098 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 26 MB/s | 8.3 MB 00:00 2020-11-20T11:47:28.124 INFO:teuthology.orchestra.run.smithi036.stdout:Extra Packages for Enterprise Linux 26 MB/s | 8.3 MB 00:00 2020-11-20T11:47:29.663 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 4.7 MB/s | 23 kB 00:00 2020-11-20T11:47:29.778 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 4.4 MB/s | 23 kB 00:00 2020-11-20T11:47:29.897 INFO:teuthology.orchestra.run.smithi036.stdout:lab-extras 4.8 MB/s | 23 kB 00:00 2020-11-20T11:47:29.935 INFO:teuthology.orchestra.run.smithi164.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 108 MB/s | 24 MB 00:00 2020-11-20T11:47:30.040 INFO:teuthology.orchestra.run.smithi188.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 112 MB/s | 24 MB 00:00 2020-11-20T11:47:30.223 INFO:teuthology.orchestra.run.smithi036.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 92 MB/s | 25 MB 00:00 2020-11-20T11:47:33.761 INFO:teuthology.orchestra.run.smithi188.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 119 MB/s | 25 MB 00:00 2020-11-20T11:47:33.928 INFO:teuthology.orchestra.run.smithi164.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 113 MB/s | 25 MB 00:00 2020-11-20T11:47:34.190 INFO:teuthology.orchestra.run.smithi036.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 87 MB/s | 24 MB 00:00 2020-11-20T11:47:39.307 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:47:39.308 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:47:39.315 INFO:teuthology.orchestra.run.smithi188.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T11:47:39.316 INFO:teuthology.orchestra.run.smithi188.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T11:47:39.316 INFO:teuthology.orchestra.run.smithi188.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T11:47:39.317 INFO:teuthology.orchestra.run.smithi188.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:47:39.318 INFO:teuthology.orchestra.run.smithi188.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:47:39.320 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:47:39.321 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T11:47:39.531 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:47:39.531 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:47:39.538 INFO:teuthology.orchestra.run.smithi164.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T11:47:39.539 INFO:teuthology.orchestra.run.smithi164.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T11:47:39.540 INFO:teuthology.orchestra.run.smithi164.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T11:47:39.540 INFO:teuthology.orchestra.run.smithi164.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:47:39.542 INFO:teuthology.orchestra.run.smithi164.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:47:39.544 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:47:39.544 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T11:47:39.643 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2020-11-20T11:47:39.680 INFO:teuthology.orchestra.run.smithi188.stdout:====================================================================================================================== 2020-11-20T11:47:39.680 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2020-11-20T11:47:39.680 INFO:teuthology.orchestra.run.smithi188.stdout:====================================================================================================================== 2020-11-20T11:47:39.681 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2020-11-20T11:47:39.681 INFO:teuthology.orchestra.run.smithi188.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T11:47:39.681 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:47:39.681 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:47:39.682 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:47:39.682 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:47:39.682 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:47:39.682 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:47:39.682 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:47:39.683 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:47:39.683 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:47:39.683 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:47:39.683 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:47:39.684 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:47:39.684 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T11:47:39.684 INFO:teuthology.orchestra.run.smithi188.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T11:47:39.684 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T11:47:39.685 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:47:39.685 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:47:39.685 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:47:39.686 INFO:teuthology.orchestra.run.smithi188.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T11:47:39.686 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T11:47:39.687 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T11:47:39.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:47:39.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:47:39.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:47:39.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:47:39.688 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:47:39.688 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:47:39.688 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:47:39.688 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T11:47:39.688 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2020-11-20T11:47:39.689 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T11:47:39.689 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T11:47:39.690 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T11:47:39.690 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T11:47:39.690 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:47:39.690 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:47:39.690 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2020-11-20T11:47:39.691 INFO:teuthology.orchestra.run.smithi188.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T11:47:39.691 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:47:39.691 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:47:39.691 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:47:39.691 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:47:39.692 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:47:39.692 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:47:39.692 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:47:39.694 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:47:39.694 INFO:teuthology.orchestra.run.smithi188.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T11:47:39.694 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T11:47:39.694 INFO:teuthology.orchestra.run.smithi188.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T11:47:39.695 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T11:47:39.695 INFO:teuthology.orchestra.run.smithi188.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T11:47:39.695 INFO:teuthology.orchestra.run.smithi188.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T11:47:39.695 INFO:teuthology.orchestra.run.smithi188.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T11:47:39.695 INFO:teuthology.orchestra.run.smithi188.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T11:47:39.696 INFO:teuthology.orchestra.run.smithi188.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T11:47:39.696 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T11:47:39.696 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T11:47:39.696 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T11:47:39.696 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T11:47:39.697 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:47:39.697 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T11:47:39.697 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:47:39.697 INFO:teuthology.orchestra.run.smithi188.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T11:47:39.698 INFO:teuthology.orchestra.run.smithi188.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T11:47:39.698 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T11:47:39.698 INFO:teuthology.orchestra.run.smithi188.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T11:47:39.698 INFO:teuthology.orchestra.run.smithi188.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T11:47:39.698 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T11:47:39.699 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T11:47:39.699 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T11:47:39.699 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T11:47:39.699 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T11:47:39.699 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T11:47:39.700 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T11:47:39.700 INFO:teuthology.orchestra.run.smithi188.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T11:47:39.700 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T11:47:39.700 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T11:47:39.700 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T11:47:39.701 INFO:teuthology.orchestra.run.smithi188.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T11:47:39.701 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T11:47:39.701 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:47:39.701 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:47:39.701 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T11:47:39.702 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T11:47:39.702 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T11:47:39.702 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T11:47:39.702 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T11:47:39.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T11:47:39.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T11:47:39.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T11:47:39.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T11:47:39.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T11:47:39.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:47:39.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T11:47:39.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:47:39.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T11:47:39.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T11:47:39.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T11:47:39.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T11:47:39.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T11:47:39.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T11:47:39.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T11:47:39.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T11:47:39.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T11:47:39.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T11:47:39.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T11:47:39.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T11:47:39.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T11:47:39.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T11:47:39.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T11:47:39.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T11:47:39.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T11:47:39.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T11:47:39.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T11:47:39.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:47:39.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T11:47:39.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T11:47:39.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T11:47:39.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T11:47:39.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T11:47:39.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T11:47:39.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T11:47:39.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T11:47:39.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:47:39.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T11:47:39.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T11:47:39.711 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T11:47:39.711 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T11:47:39.711 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T11:47:39.711 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T11:47:39.711 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T11:47:39.712 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T11:47:39.712 INFO:teuthology.orchestra.run.smithi188.stdout:Installing weak dependencies: 2020-11-20T11:47:39.712 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T11:47:39.712 INFO:teuthology.orchestra.run.smithi188.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T11:47:39.712 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:47:39.713 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2020-11-20T11:47:39.713 INFO:teuthology.orchestra.run.smithi188.stdout:====================================================================================================================== 2020-11-20T11:47:39.713 INFO:teuthology.orchestra.run.smithi188.stdout:Install 127 Packages 2020-11-20T11:47:39.713 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 6 Packages 2020-11-20T11:47:39.713 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:47:39.714 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 199 M 2020-11-20T11:47:39.714 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2020-11-20T11:47:39.790 INFO:teuthology.orchestra.run.smithi188.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 64 kB/s | 6.4 kB 00:00 2020-11-20T11:47:39.891 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2020-11-20T11:47:39.919 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================================================== 2020-11-20T11:47:39.920 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2020-11-20T11:47:39.920 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================================================== 2020-11-20T11:47:39.920 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2020-11-20T11:47:39.920 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T11:47:39.920 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:47:39.921 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:47:39.921 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:47:39.921 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:47:39.921 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:47:39.922 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:47:39.922 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:47:39.922 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:47:39.922 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:47:39.922 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:47:39.923 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:47:39.923 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:47:39.923 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T11:47:39.923 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T11:47:39.923 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T11:47:39.924 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:47:39.924 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:47:39.924 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:47:39.924 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T11:47:39.925 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T11:47:39.925 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T11:47:39.925 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:47:39.925 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:47:39.925 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:47:39.926 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:47:39.926 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:47:39.926 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:47:39.926 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:47:39.926 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T11:47:39.927 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2020-11-20T11:47:39.927 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T11:47:39.927 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T11:47:39.927 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T11:47:39.927 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T11:47:39.928 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:47:39.928 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:47:39.928 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2020-11-20T11:47:39.928 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T11:47:39.928 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:47:39.929 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:47:39.929 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:47:39.929 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:47:39.929 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:47:39.929 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:47:39.930 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:47:39.930 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:47:39.930 INFO:teuthology.orchestra.run.smithi164.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T11:47:39.930 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T11:47:39.930 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T11:47:39.931 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T11:47:39.931 INFO:teuthology.orchestra.run.smithi164.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T11:47:39.931 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T11:47:39.931 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T11:47:39.931 INFO:teuthology.orchestra.run.smithi164.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T11:47:39.932 INFO:teuthology.orchestra.run.smithi164.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T11:47:39.932 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T11:47:39.932 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T11:47:39.932 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T11:47:39.932 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T11:47:39.933 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:47:39.933 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T11:47:39.933 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:47:39.933 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T11:47:39.933 INFO:teuthology.orchestra.run.smithi164.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T11:47:39.934 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T11:47:39.934 INFO:teuthology.orchestra.run.smithi164.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T11:47:39.934 INFO:teuthology.orchestra.run.smithi164.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T11:47:39.934 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T11:47:39.935 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T11:47:39.935 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T11:47:39.935 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T11:47:39.935 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T11:47:39.935 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T11:47:39.936 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T11:47:39.936 INFO:teuthology.orchestra.run.smithi164.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T11:47:39.936 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T11:47:39.936 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T11:47:39.936 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T11:47:39.937 INFO:teuthology.orchestra.run.smithi164.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T11:47:39.937 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T11:47:39.937 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:47:39.937 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:47:39.937 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T11:47:39.938 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T11:47:39.938 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T11:47:39.938 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T11:47:39.938 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T11:47:39.938 INFO:teuthology.orchestra.run.smithi164.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T11:47:39.939 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T11:47:39.939 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T11:47:39.939 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T11:47:39.939 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T11:47:39.939 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:47:39.940 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T11:47:39.940 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:47:39.940 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T11:47:39.940 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T11:47:39.940 INFO:teuthology.orchestra.run.smithi164.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T11:47:39.941 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T11:47:39.941 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T11:47:39.941 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T11:47:39.941 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T11:47:39.941 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T11:47:39.942 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T11:47:39.942 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T11:47:39.942 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T11:47:39.942 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T11:47:39.942 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T11:47:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T11:47:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T11:47:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T11:47:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T11:47:39.943 INFO:teuthology.orchestra.run.smithi164.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T11:47:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T11:47:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:47:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T11:47:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T11:47:39.944 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T11:47:39.945 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T11:47:39.945 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T11:47:39.945 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T11:47:39.945 INFO:teuthology.orchestra.run.smithi164.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T11:47:39.945 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T11:47:39.946 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:47:39.946 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T11:47:39.946 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T11:47:39.946 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T11:47:39.947 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T11:47:39.947 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T11:47:39.947 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T11:47:39.947 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T11:47:39.947 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T11:47:39.948 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2020-11-20T11:47:39.948 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T11:47:39.948 INFO:teuthology.orchestra.run.smithi164.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T11:47:39.948 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:47:39.948 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2020-11-20T11:47:39.949 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================================================== 2020-11-20T11:47:39.949 INFO:teuthology.orchestra.run.smithi164.stdout:Install 127 Packages 2020-11-20T11:47:39.949 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 6 Packages 2020-11-20T11:47:39.949 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:47:39.950 INFO:teuthology.orchestra.run.smithi188.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 4.4 MB/s | 632 kB 00:00 2020-11-20T11:47:39.950 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 199 M 2020-11-20T11:47:39.951 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2020-11-20T11:47:39.961 INFO:teuthology.orchestra.run.smithi188.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 6.6 MB/s | 204 kB 00:00 2020-11-20T11:47:40.094 INFO:teuthology.orchestra.run.smithi164.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 40 kB/s | 6.4 kB 00:00 2020-11-20T11:47:40.211 INFO:teuthology.orchestra.run.smithi188.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 8.6 MB/s | 2.1 MB 00:00 2020-11-20T11:47:40.238 INFO:teuthology.orchestra.run.smithi036.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:47:40.238 INFO:teuthology.orchestra.run.smithi036.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:47:40.245 INFO:teuthology.orchestra.run.smithi036.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T11:47:40.246 INFO:teuthology.orchestra.run.smithi036.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T11:47:40.247 INFO:teuthology.orchestra.run.smithi036.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T11:47:40.248 INFO:teuthology.orchestra.run.smithi036.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:47:40.249 INFO:teuthology.orchestra.run.smithi036.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:47:40.251 INFO:teuthology.orchestra.run.smithi036.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:47:40.252 INFO:teuthology.orchestra.run.smithi036.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T11:47:40.431 INFO:teuthology.orchestra.run.smithi188.stdout:(5/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 7.0 MB/s | 1.5 MB 00:00 2020-11-20T11:47:40.476 INFO:teuthology.orchestra.run.smithi188.stdout:(6/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 7.6 MB/s | 6.0 MB 00:00 2020-11-20T11:47:40.586 INFO:teuthology.orchestra.run.smithi036.stdout:Dependencies resolved. 2020-11-20T11:47:40.612 INFO:teuthology.orchestra.run.smithi036.stdout:====================================================================================================================== 2020-11-20T11:47:40.613 INFO:teuthology.orchestra.run.smithi036.stdout: Package Arch Version Repository Size 2020-11-20T11:47:40.613 INFO:teuthology.orchestra.run.smithi036.stdout:====================================================================================================================== 2020-11-20T11:47:40.613 INFO:teuthology.orchestra.run.smithi036.stdout:Installing: 2020-11-20T11:47:40.613 INFO:teuthology.orchestra.run.smithi036.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T11:47:40.614 INFO:teuthology.orchestra.run.smithi036.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:47:40.614 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:47:40.614 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:47:40.614 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:47:40.614 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:47:40.615 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:47:40.615 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:47:40.615 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:47:40.615 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:47:40.615 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:47:40.616 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:47:40.616 INFO:teuthology.orchestra.run.smithi036.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:47:40.616 INFO:teuthology.orchestra.run.smithi036.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T11:47:40.616 INFO:teuthology.orchestra.run.smithi036.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T11:47:40.616 INFO:teuthology.orchestra.run.smithi036.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T11:47:40.617 INFO:teuthology.orchestra.run.smithi036.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:47:40.617 INFO:teuthology.orchestra.run.smithi036.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:47:40.617 INFO:teuthology.orchestra.run.smithi036.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:47:40.617 INFO:teuthology.orchestra.run.smithi036.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T11:47:40.617 INFO:teuthology.orchestra.run.smithi036.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T11:47:40.618 INFO:teuthology.orchestra.run.smithi036.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T11:47:40.618 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:47:40.618 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:47:40.618 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:47:40.618 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:47:40.619 INFO:teuthology.orchestra.run.smithi036.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:47:40.619 INFO:teuthology.orchestra.run.smithi036.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:47:40.619 INFO:teuthology.orchestra.run.smithi036.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:47:40.619 INFO:teuthology.orchestra.run.smithi036.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T11:47:40.619 INFO:teuthology.orchestra.run.smithi036.stdout:Upgrading: 2020-11-20T11:47:40.620 INFO:teuthology.orchestra.run.smithi036.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T11:47:40.620 INFO:teuthology.orchestra.run.smithi036.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T11:47:40.620 INFO:teuthology.orchestra.run.smithi036.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T11:47:40.620 INFO:teuthology.orchestra.run.smithi036.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T11:47:40.620 INFO:teuthology.orchestra.run.smithi036.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:47:40.621 INFO:teuthology.orchestra.run.smithi036.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:47:40.621 INFO:teuthology.orchestra.run.smithi036.stdout:Installing dependencies: 2020-11-20T11:47:40.621 INFO:teuthology.orchestra.run.smithi036.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T11:47:40.621 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:47:40.622 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:47:40.622 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:47:40.622 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:47:40.622 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:47:40.622 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:47:40.622 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:47:40.623 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:47:40.623 INFO:teuthology.orchestra.run.smithi036.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T11:47:40.623 INFO:teuthology.orchestra.run.smithi036.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T11:47:40.623 INFO:teuthology.orchestra.run.smithi036.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T11:47:40.623 INFO:teuthology.orchestra.run.smithi036.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T11:47:40.624 INFO:teuthology.orchestra.run.smithi036.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T11:47:40.624 INFO:teuthology.orchestra.run.smithi036.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T11:47:40.624 INFO:teuthology.orchestra.run.smithi036.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T11:47:40.624 INFO:teuthology.orchestra.run.smithi036.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T11:47:40.624 INFO:teuthology.orchestra.run.smithi036.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T11:47:40.625 INFO:teuthology.orchestra.run.smithi036.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T11:47:40.625 INFO:teuthology.orchestra.run.smithi036.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T11:47:40.625 INFO:teuthology.orchestra.run.smithi036.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T11:47:40.625 INFO:teuthology.orchestra.run.smithi036.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T11:47:40.626 INFO:teuthology.orchestra.run.smithi036.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:47:40.626 INFO:teuthology.orchestra.run.smithi036.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T11:47:40.626 INFO:teuthology.orchestra.run.smithi036.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:47:40.626 INFO:teuthology.orchestra.run.smithi036.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T11:47:40.626 INFO:teuthology.orchestra.run.smithi036.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T11:47:40.626 INFO:teuthology.orchestra.run.smithi036.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T11:47:40.627 INFO:teuthology.orchestra.run.smithi036.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T11:47:40.627 INFO:teuthology.orchestra.run.smithi036.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T11:47:40.627 INFO:teuthology.orchestra.run.smithi036.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T11:47:40.627 INFO:teuthology.orchestra.run.smithi036.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T11:47:40.628 INFO:teuthology.orchestra.run.smithi036.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T11:47:40.628 INFO:teuthology.orchestra.run.smithi036.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T11:47:40.628 INFO:teuthology.orchestra.run.smithi036.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T11:47:40.628 INFO:teuthology.orchestra.run.smithi036.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T11:47:40.628 INFO:teuthology.orchestra.run.smithi036.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T11:47:40.629 INFO:teuthology.orchestra.run.smithi036.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T11:47:40.629 INFO:teuthology.orchestra.run.smithi036.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T11:47:40.629 INFO:teuthology.orchestra.run.smithi036.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T11:47:40.629 INFO:teuthology.orchestra.run.smithi036.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T11:47:40.629 INFO:teuthology.orchestra.run.smithi036.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T11:47:40.630 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T11:47:40.630 INFO:teuthology.orchestra.run.smithi036.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:47:40.630 INFO:teuthology.orchestra.run.smithi036.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:47:40.630 INFO:teuthology.orchestra.run.smithi036.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T11:47:40.630 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T11:47:40.631 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T11:47:40.631 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T11:47:40.631 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T11:47:40.631 INFO:teuthology.orchestra.run.smithi036.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T11:47:40.631 INFO:teuthology.orchestra.run.smithi036.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T11:47:40.632 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T11:47:40.632 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T11:47:40.632 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T11:47:40.632 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:47:40.632 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T11:47:40.633 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:47:40.633 INFO:teuthology.orchestra.run.smithi036.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T11:47:40.633 INFO:teuthology.orchestra.run.smithi036.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T11:47:40.633 INFO:teuthology.orchestra.run.smithi036.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T11:47:40.633 INFO:teuthology.orchestra.run.smithi036.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T11:47:40.634 INFO:teuthology.orchestra.run.smithi036.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T11:47:40.634 INFO:teuthology.orchestra.run.smithi036.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T11:47:40.634 INFO:teuthology.orchestra.run.smithi036.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T11:47:40.634 INFO:teuthology.orchestra.run.smithi036.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T11:47:40.634 INFO:teuthology.orchestra.run.smithi036.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T11:47:40.635 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T11:47:40.635 INFO:teuthology.orchestra.run.smithi036.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T11:47:40.635 INFO:teuthology.orchestra.run.smithi036.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T11:47:40.635 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T11:47:40.635 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T11:47:40.636 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T11:47:40.636 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T11:47:40.636 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T11:47:40.636 INFO:teuthology.orchestra.run.smithi036.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T11:47:40.636 INFO:teuthology.orchestra.run.smithi036.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T11:47:40.637 INFO:teuthology.orchestra.run.smithi036.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:47:40.637 INFO:teuthology.orchestra.run.smithi036.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T11:47:40.637 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T11:47:40.637 INFO:teuthology.orchestra.run.smithi036.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T11:47:40.637 INFO:teuthology.orchestra.run.smithi036.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T11:47:40.638 INFO:teuthology.orchestra.run.smithi036.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T11:47:40.638 INFO:teuthology.orchestra.run.smithi036.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T11:47:40.638 INFO:teuthology.orchestra.run.smithi036.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T11:47:40.638 INFO:teuthology.orchestra.run.smithi036.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T11:47:40.638 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:47:40.639 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T11:47:40.639 INFO:teuthology.orchestra.run.smithi036.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T11:47:40.639 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T11:47:40.639 INFO:teuthology.orchestra.run.smithi036.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T11:47:40.640 INFO:teuthology.orchestra.run.smithi036.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T11:47:40.640 INFO:teuthology.orchestra.run.smithi036.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T11:47:40.640 INFO:teuthology.orchestra.run.smithi036.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T11:47:40.640 INFO:teuthology.orchestra.run.smithi036.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T11:47:40.641 INFO:teuthology.orchestra.run.smithi036.stdout:Installing weak dependencies: 2020-11-20T11:47:40.641 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T11:47:40.641 INFO:teuthology.orchestra.run.smithi036.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T11:47:40.641 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:47:40.641 INFO:teuthology.orchestra.run.smithi036.stdout:Transaction Summary 2020-11-20T11:47:40.642 INFO:teuthology.orchestra.run.smithi036.stdout:====================================================================================================================== 2020-11-20T11:47:40.642 INFO:teuthology.orchestra.run.smithi036.stdout:Install 127 Packages 2020-11-20T11:47:40.642 INFO:teuthology.orchestra.run.smithi036.stdout:Upgrade 6 Packages 2020-11-20T11:47:40.642 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:47:40.643 INFO:teuthology.orchestra.run.smithi036.stdout:Total download size: 199 M 2020-11-20T11:47:40.643 INFO:teuthology.orchestra.run.smithi036.stdout:Downloading Packages: 2020-11-20T11:47:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 908 kB/s | 632 kB 00:00 2020-11-20T11:47:40.955 INFO:teuthology.orchestra.run.smithi036.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2020-11-20T11:47:41.057 INFO:teuthology.orchestra.run.smithi188.stdout:(7/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 7.9 MB/s | 5.0 MB 00:00 2020-11-20T11:47:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 702 kB/s | 204 kB 00:00 2020-11-20T11:47:41.590 INFO:teuthology.orchestra.run.smithi036.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 996 kB/s | 632 kB 00:00 2020-11-20T11:47:41.750 INFO:teuthology.orchestra.run.smithi036.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 1.2 MB/s | 204 kB 00:00 2020-11-20T11:47:42.703 INFO:teuthology.orchestra.run.smithi188.stdout:(8/133): ceph-common-16.0.0-7397.gb86e691b.el8. 7.6 MB/s | 23 MB 00:03 2020-11-20T11:47:42.781 INFO:teuthology.orchestra.run.smithi188.stdout:(9/133): ceph-radosgw-16.0.0-7397.gb86e691b.el8 6.9 MB/s | 12 MB 00:01 2020-11-20T11:47:42.852 INFO:teuthology.orchestra.run.smithi188.stdout:(10/133): ceph-selinux-16.0.0-7397.gb86e691b.el 167 kB/s | 25 kB 00:00 2020-11-20T11:47:42.880 INFO:teuthology.orchestra.run.smithi164.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 1.2 MB/s | 2.1 MB 00:01 2020-11-20T11:47:42.969 INFO:teuthology.orchestra.run.smithi036.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 1.8 MB/s | 2.1 MB 00:01 2020-11-20T11:47:42.979 INFO:teuthology.orchestra.run.smithi188.stdout:(11/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 7.2 MB/s | 18 MB 00:02 2020-11-20T11:47:42.980 INFO:teuthology.orchestra.run.smithi188.stdout:(12/133): libcephfs-devel-16.0.0-7397.gb86e691b 185 kB/s | 24 kB 00:00 2020-11-20T11:47:43.041 INFO:teuthology.orchestra.run.smithi188.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 2.1 MB/s | 131 kB 00:00 2020-11-20T11:47:43.085 INFO:teuthology.orchestra.run.smithi188.stdout:(14/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 5.2 MB/s | 562 kB 00:00 2020-11-20T11:47:43.123 INFO:teuthology.orchestra.run.smithi164.stdout:(5/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 1.9 MB/s | 6.0 MB 00:03 2020-11-20T11:47:43.159 INFO:teuthology.orchestra.run.smithi188.stdout:(15/133): libradosstriper1-16.0.0-7397.gb86e691 4.0 MB/s | 486 kB 00:00 2020-11-20T11:47:43.222 INFO:teuthology.orchestra.run.smithi188.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 636 kB/s | 40 kB 00:00 2020-11-20T11:47:43.310 INFO:teuthology.orchestra.run.smithi188.stdout:(17/133): python3-ceph-common-16.0.0-7397.gb86e 832 kB/s | 73 kB 00:00 2020-11-20T11:47:43.382 INFO:teuthology.orchestra.run.smithi188.stdout:(18/133): python3-cephfs-16.0.0-7397.gb86e691b. 2.8 MB/s | 204 kB 00:00 2020-11-20T11:47:43.604 INFO:teuthology.orchestra.run.smithi188.stdout:(19/133): python3-rados-16.0.0-7397.gb86e691b.e 1.6 MB/s | 375 kB 00:00 2020-11-20T11:47:43.618 INFO:teuthology.orchestra.run.smithi188.stdout:(20/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 7.0 MB/s | 3.7 MB 00:00 2020-11-20T11:47:43.669 INFO:teuthology.orchestra.run.smithi188.stdout:(21/133): python3-rbd-16.0.0-7397.gb86e691b.el8 5.4 MB/s | 353 kB 00:00 2020-11-20T11:47:43.679 INFO:teuthology.orchestra.run.smithi188.stdout:(22/133): python3-rgw-16.0.0-7397.gb86e691b.el8 1.7 MB/s | 113 kB 00:00 2020-11-20T11:47:43.721 INFO:teuthology.orchestra.run.smithi036.stdout:(5/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 2.0 MB/s | 1.5 MB 00:00 2020-11-20T11:47:43.724 INFO:teuthology.orchestra.run.smithi188.stdout:(23/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.6 MB/s | 88 kB 00:00 2020-11-20T11:47:43.833 INFO:teuthology.orchestra.run.smithi188.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 1.5 MB/s | 171 kB 00:00 2020-11-20T11:47:43.897 INFO:teuthology.orchestra.run.smithi164.stdout:(6/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 1.5 MB/s | 1.5 MB 00:01 2020-11-20T11:47:43.898 INFO:teuthology.orchestra.run.smithi188.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 370 kB/s | 24 kB 00:00 2020-11-20T11:47:43.968 INFO:teuthology.orchestra.run.smithi188.stdout:(26/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 950 kB/s | 66 kB 00:00 2020-11-20T11:47:44.162 INFO:teuthology.orchestra.run.smithi188.stdout:(27/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 6.6 MB/s | 3.2 MB 00:00 2020-11-20T11:47:44.529 INFO:teuthology.orchestra.run.smithi188.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 5.7 MB/s | 3.2 MB 00:00 2020-11-20T11:47:44.695 INFO:teuthology.orchestra.run.smithi188.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 1.2 MB/s | 198 kB 00:00 2020-11-20T11:47:44.934 INFO:teuthology.orchestra.run.smithi188.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 114 kB/s | 27 kB 00:00 2020-11-20T11:47:45.001 INFO:teuthology.orchestra.run.smithi188.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 132 kB/s | 8.8 kB 00:00 2020-11-20T11:47:45.431 INFO:teuthology.orchestra.run.smithi164.stdout:(7/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 2.6 MB/s | 5.0 MB 00:01 2020-11-20T11:47:45.431 INFO:teuthology.orchestra.run.smithi188.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 878 kB/s | 57 kB 00:00 2020-11-20T11:47:45.432 INFO:teuthology.orchestra.run.smithi188.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.4 MB/s | 116 kB 00:00 2020-11-20T11:47:45.432 INFO:teuthology.orchestra.run.smithi188.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 9.2 MB/s | 315 kB 00:00 2020-11-20T11:47:45.432 INFO:teuthology.orchestra.run.smithi188.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 10 MB/s | 181 kB 00:00 2020-11-20T11:47:45.432 INFO:teuthology.orchestra.run.smithi188.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 3.3 MB/s | 59 kB 00:00 2020-11-20T11:47:45.432 INFO:teuthology.orchestra.run.smithi188.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 4.4 MB/s | 75 kB 00:00 2020-11-20T11:47:45.433 INFO:teuthology.orchestra.run.smithi188.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.2 MB/s | 21 kB 00:00 2020-11-20T11:47:45.433 INFO:teuthology.orchestra.run.smithi188.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.6 MB/s | 44 kB 00:00 2020-11-20T11:47:45.433 INFO:teuthology.orchestra.run.smithi188.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 9.9 MB/s | 185 kB 00:00 2020-11-20T11:47:45.433 INFO:teuthology.orchestra.run.smithi188.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 2.0 MB/s | 33 kB 00:00 2020-11-20T11:47:45.434 INFO:teuthology.orchestra.run.smithi188.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 977 kB/s | 16 kB 00:00 2020-11-20T11:47:45.434 INFO:teuthology.orchestra.run.smithi188.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 7.9 MB/s | 145 kB 00:00 2020-11-20T11:47:45.434 INFO:teuthology.orchestra.run.smithi188.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 20 MB/s | 384 kB 00:00 2020-11-20T11:47:45.434 INFO:teuthology.orchestra.run.smithi188.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.3 MB/s | 40 kB 00:00 2020-11-20T11:47:45.434 INFO:teuthology.orchestra.run.smithi188.stdout:(46/133): ceph-mgr-diskprediction-local-16.0.0- 6.9 MB/s | 8.6 MB 00:01 2020-11-20T11:47:45.435 INFO:teuthology.orchestra.run.smithi188.stdout:(47/133): python3-execnet-1.7.1-1.el8.noarch.rp 12 MB/s | 355 kB 00:00 2020-11-20T11:47:45.435 INFO:teuthology.orchestra.run.smithi188.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 676 kB/s | 11 kB 00:00 2020-11-20T11:47:45.435 INFO:teuthology.orchestra.run.smithi188.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 1.0 MB/s | 18 kB 00:00 2020-11-20T11:47:45.476 INFO:teuthology.orchestra.run.smithi188.stdout:(50/133): python3-google-auth-1.1.1-10.el8.noar 1.0 MB/s | 81 kB 00:00 2020-11-20T11:47:45.486 INFO:teuthology.orchestra.run.smithi188.stdout:(51/133): python3-kubernetes-11.0.0-2.el8.noarc 22 MB/s | 1.2 MB 00:00 2020-11-20T11:47:45.496 INFO:teuthology.orchestra.run.smithi188.stdout:(52/133): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2020-11-20T11:47:45.503 INFO:teuthology.orchestra.run.smithi188.stdout:(53/133): python3-more-itertools-7.2.0-3.el8.no 3.4 MB/s | 59 kB 00:00 2020-11-20T11:47:45.520 INFO:teuthology.orchestra.run.smithi188.stdout:(54/133): python3-portend-2.6-1.el8.noarch.rpm 949 kB/s | 16 kB 00:00 2020-11-20T11:47:45.537 INFO:teuthology.orchestra.run.smithi188.stdout:(55/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.8 MB/s | 48 kB 00:00 2020-11-20T11:47:45.553 INFO:teuthology.orchestra.run.smithi188.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 2.0 MB/s | 34 kB 00:00 2020-11-20T11:47:45.554 INFO:teuthology.orchestra.run.smithi188.stdout:(57/133): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2020-11-20T11:47:45.571 INFO:teuthology.orchestra.run.smithi188.stdout:(58/133): python3-routes-2.4.1-12.el8.noarch.rp 11 MB/s | 196 kB 00:00 2020-11-20T11:47:45.575 INFO:teuthology.orchestra.run.smithi188.stdout:(59/133): python3-rsa-3.4.2-15.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2020-11-20T11:47:45.588 INFO:teuthology.orchestra.run.smithi188.stdout:(60/133): python3-simplegeneric-0.8.1-17.el8.no 1.1 MB/s | 19 kB 00:00 2020-11-20T11:47:45.595 INFO:teuthology.orchestra.run.smithi188.stdout:(61/133): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2020-11-20T11:47:45.604 INFO:teuthology.orchestra.run.smithi188.stdout:(62/133): python3-tempora-1.14.1-5.el8.noarch.r 1.8 MB/s | 29 kB 00:00 2020-11-20T11:47:45.615 INFO:teuthology.orchestra.run.smithi188.stdout:(63/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.3 MB/s | 27 kB 00:00 2020-11-20T11:47:45.624 INFO:teuthology.orchestra.run.smithi188.stdout:(64/133): python3-waitress-1.2.1-2.el8.1.noarch 12 MB/s | 241 kB 00:00 2020-11-20T11:47:45.637 INFO:teuthology.orchestra.run.smithi188.stdout:(65/133): python3-webob-1.8.5-1.el8.1.noarch.rp 11 MB/s | 251 kB 00:00 2020-11-20T11:47:45.641 INFO:teuthology.orchestra.run.smithi188.stdout:(66/133): python3-websocket-client-0.56.0-5.el8 3.5 MB/s | 61 kB 00:00 2020-11-20T11:47:45.657 INFO:teuthology.orchestra.run.smithi188.stdout:(67/133): python3-webtest-2.0.33-1.el8.noarch.r 4.1 MB/s | 85 kB 00:00 2020-11-20T11:47:45.657 INFO:teuthology.orchestra.run.smithi188.stdout:(68/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.4 MB/s | 23 kB 00:00 2020-11-20T11:47:45.681 INFO:teuthology.orchestra.run.smithi188.stdout:(69/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 2.9 MB/s | 69 kB 00:00 2020-11-20T11:47:45.693 INFO:teuthology.orchestra.run.smithi188.stdout:(70/133): automake-1.16.1-6.el8.noarch.rpm 20 MB/s | 713 kB 00:00 2020-11-20T11:47:45.715 INFO:teuthology.orchestra.run.smithi188.stdout:(71/133): python3-webencodings-0.5.1-6.el8.noar 794 kB/s | 27 kB 00:00 2020-11-20T11:47:45.735 INFO:teuthology.orchestra.run.smithi188.stdout:(72/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 40 MB/s | 1.5 MB 00:00 2020-11-20T11:47:45.736 INFO:teuthology.orchestra.run.smithi188.stdout:(73/133): jq-1.5-12.el8.x86_64.rpm 7.5 MB/s | 161 kB 00:00 2020-11-20T11:47:45.759 INFO:teuthology.orchestra.run.smithi188.stdout:(74/133): python3-pyOpenSSL-18.0.0-1.el8.noarch 4.1 MB/s | 103 kB 00:00 2020-11-20T11:47:45.769 INFO:teuthology.orchestra.run.smithi188.stdout:(75/133): python3-werkzeug-0.12.2-4.el8.noarch. 14 MB/s | 457 kB 00:00 2020-11-20T11:47:45.781 INFO:teuthology.orchestra.run.smithi188.stdout:(76/133): python3-mako-1.0.6-13.el8.noarch.rpm 6.9 MB/s | 157 kB 00:00 2020-11-20T11:47:45.794 INFO:teuthology.orchestra.run.smithi188.stdout:(77/133): python3-jsonpatch-1.21-2.el8.noarch.r 1.3 MB/s | 27 kB 00:00 2020-11-20T11:47:45.805 INFO:teuthology.orchestra.run.smithi188.stdout:(78/133): python3-jsonpointer-1.10-11.el8.noarc 857 kB/s | 20 kB 00:00 2020-11-20T11:47:45.822 INFO:teuthology.orchestra.run.smithi188.stdout:(79/133): python3-html5lib-0.999999999-6.el8.no 7.3 MB/s | 214 kB 00:00 2020-11-20T11:47:45.830 INFO:teuthology.orchestra.run.smithi188.stdout:(80/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.0 MB/s | 126 kB 00:00 2020-11-20T11:47:45.846 INFO:teuthology.orchestra.run.smithi188.stdout:(81/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.2 MB/s | 54 kB 00:00 2020-11-20T11:47:45.854 INFO:teuthology.orchestra.run.smithi188.stdout:(82/133): python3-pyasn1-modules-0.3.7-6.el8.no 4.5 MB/s | 110 kB 00:00 2020-11-20T11:47:45.871 INFO:teuthology.orchestra.run.smithi188.stdout:(83/133): python3-prettytable-0.7.2-14.el8.noar 1.8 MB/s | 44 kB 00:00 2020-11-20T11:47:45.879 INFO:teuthology.orchestra.run.smithi188.stdout:(84/133): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2020-11-20T11:47:45.899 INFO:teuthology.orchestra.run.smithi188.stdout:(85/133): flex-2.6.1-9.el8.x86_64.rpm 11 MB/s | 320 kB 00:00 2020-11-20T11:47:45.909 INFO:teuthology.orchestra.run.smithi188.stdout:(86/133): librdkafka-0.11.4-1.el8.x86_64.rpm 12 MB/s | 353 kB 00:00 2020-11-20T11:47:45.928 INFO:teuthology.orchestra.run.smithi188.stdout:(87/133): bison-3.0.4-10.el8.x86_64.rpm 23 MB/s | 688 kB 00:00 2020-11-20T11:47:45.943 INFO:teuthology.orchestra.run.smithi188.stdout:(88/133): libtool-2.4.6-25.el8.x86_64.rpm 23 MB/s | 709 kB 00:00 2020-11-20T11:47:45.954 INFO:teuthology.orchestra.run.smithi188.stdout:(89/133): python3-jinja2-2.10.1-2.el8_0.noarch. 20 MB/s | 538 kB 00:00 2020-11-20T11:47:45.981 INFO:teuthology.orchestra.run.smithi188.stdout:(90/133): python3-numpy-f2py-1.14.3-9.el8.x86_6 10 MB/s | 225 kB 00:00 2020-11-20T11:47:46.143 INFO:teuthology.orchestra.run.smithi188.stdout:(91/133): python3-scipy-1.0.0-20.module+el8.1.0 73 MB/s | 15 MB 00:00 2020-11-20T11:47:46.162 INFO:teuthology.orchestra.run.smithi188.stdout:(92/133): python3-babel-2.5.1-5.el8.noarch.rpm 27 MB/s | 4.8 MB 00:00 2020-11-20T11:47:46.172 INFO:teuthology.orchestra.run.smithi036.stdout:(6/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 2.0 MB/s | 5.0 MB 00:02 2020-11-20T11:47:46.180 INFO:teuthology.orchestra.run.smithi188.stdout:(93/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.7 MB/s | 259 kB 00:00 2020-11-20T11:47:46.221 INFO:teuthology.orchestra.run.smithi188.stdout:(94/133): python3-numpy-1.14.3-9.el8.x86_64.rpm 63 MB/s | 3.7 MB 00:00 2020-11-20T11:47:46.247 INFO:teuthology.orchestra.run.smithi188.stdout:(95/133): openblas-threads-0.3.3-5.el8.x86_64.r 65 MB/s | 4.4 MB 00:00 2020-11-20T11:47:46.270 INFO:teuthology.orchestra.run.smithi188.stdout:(96/133): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2020-11-20T11:47:46.289 INFO:teuthology.orchestra.run.smithi188.stdout:(97/133): openblas-0.3.3-5.el8.x86_64.rpm 63 MB/s | 4.3 MB 00:00 2020-11-20T11:47:46.302 INFO:teuthology.orchestra.run.smithi188.stdout:(98/133): oniguruma-6.8.2-2.el8.x86_64.rpm 5.7 MB/s | 187 kB 00:00 2020-11-20T11:47:46.321 INFO:teuthology.orchestra.run.smithi188.stdout:(99/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 8.2 MB/s | 238 kB 00:00 2020-11-20T11:47:46.328 INFO:teuthology.orchestra.run.smithi188.stdout:(100/133): libverto-devel-0.3.0-5.el8.x86_64.rp 810 kB/s | 18 kB 00:00 2020-11-20T11:47:46.348 INFO:teuthology.orchestra.run.smithi188.stdout:(101/133): python3-asn1crypto-0.24.0-3.el8.noar 6.7 MB/s | 181 kB 00:00 2020-11-20T11:47:46.356 INFO:teuthology.orchestra.run.smithi188.stdout:(102/133): python3-requests-oauthlib-1.0.0-1.el 1.5 MB/s | 43 kB 00:00 2020-11-20T11:47:46.370 INFO:teuthology.orchestra.run.smithi188.stdout:(103/133): fuse-2.9.7-12.el8.x86_64.rpm 3.8 MB/s | 83 kB 00:00 2020-11-20T11:47:46.382 INFO:teuthology.orchestra.run.smithi188.stdout:(104/133): python3-pycparser-2.14-14.el8.noarch 4.2 MB/s | 109 kB 00:00 2020-11-20T11:47:46.401 INFO:teuthology.orchestra.run.smithi188.stdout:(105/133): keyutils-libs-devel-1.5.10-6.el8.x86 1.5 MB/s | 48 kB 00:00 2020-11-20T11:47:46.407 INFO:teuthology.orchestra.run.smithi188.stdout:(106/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.9 MB/s | 43 kB 00:00 2020-11-20T11:47:46.426 INFO:teuthology.orchestra.run.smithi188.stdout:(107/133): python3-oauthlib-2.1.0-1.el8.noarch. 6.1 MB/s | 155 kB 00:00 2020-11-20T11:47:46.432 INFO:teuthology.orchestra.run.smithi188.stdout:(108/133): fuse-common-3.2.1-12.el8.x86_64.rpm 858 kB/s | 21 kB 00:00 2020-11-20T11:47:46.451 INFO:teuthology.orchestra.run.smithi188.stdout:(109/133): libsepol-devel-2.9-1.el8.x86_64.rpm 3.3 MB/s | 86 kB 00:00 2020-11-20T11:47:46.458 INFO:teuthology.orchestra.run.smithi188.stdout:(110/133): libaio-devel-0.3.112-1.el8.x86_64.rp 727 kB/s | 19 kB 00:00 2020-11-20T11:47:46.476 INFO:teuthology.orchestra.run.smithi188.stdout:(111/133): libselinux-devel-2.9-3.el8.x86_64.rp 7.7 MB/s | 199 kB 00:00 2020-11-20T11:47:46.487 INFO:teuthology.orchestra.run.smithi188.stdout:(112/133): python3-cryptography-2.3-3.el8.x86_6 18 MB/s | 511 kB 00:00 2020-11-20T11:47:46.498 INFO:teuthology.orchestra.run.smithi188.stdout:(113/133): zlib-devel-1.2.11-16.el8_2.x86_64.rp 2.6 MB/s | 57 kB 00:00 2020-11-20T11:47:46.516 INFO:teuthology.orchestra.run.smithi188.stdout:(114/133): libuuid-devel-2.32.1-24.el8.x86_64.r 3.8 MB/s | 96 kB 00:00 2020-11-20T11:47:46.525 INFO:teuthology.orchestra.run.smithi188.stdout:(115/133): libxslt-1.1.32-5.el8.x86_64.rpm 9.2 MB/s | 250 kB 00:00 2020-11-20T11:47:46.538 INFO:teuthology.orchestra.run.smithi188.stdout:(116/133): libcom_err-devel-1.45.6-1.el8.x86_64 1.7 MB/s | 38 kB 00:00 2020-11-20T11:47:46.551 INFO:teuthology.orchestra.run.smithi188.stdout:(117/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 6.5 MB/s | 169 kB 00:00 2020-11-20T11:47:46.567 INFO:teuthology.orchestra.run.smithi188.stdout:(118/133): pcre2-devel-10.32-2.el8.x86_64.rpm 24 MB/s | 605 kB 00:00 2020-11-20T11:47:46.589 INFO:teuthology.orchestra.run.smithi188.stdout:(119/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 17 MB/s | 639 kB 00:00 2020-11-20T11:47:46.595 INFO:teuthology.orchestra.run.smithi188.stdout:(120/133): elfutils-libelf-devel-0.180-1.el8.x8 2.3 MB/s | 58 kB 00:00 2020-11-20T11:47:46.614 INFO:teuthology.orchestra.run.smithi188.stdout:(121/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.6 MB/s | 220 kB 00:00 2020-11-20T11:47:46.622 INFO:teuthology.orchestra.run.smithi188.stdout:(122/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.5 MB/s | 229 kB 00:00 2020-11-20T11:47:46.641 INFO:teuthology.orchestra.run.smithi188.stdout:(123/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 20 MB/s | 558 kB 00:00 2020-11-20T11:47:46.649 INFO:teuthology.orchestra.run.smithi188.stdout:(124/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rp 2.5 MB/s | 69 kB 00:00 2020-11-20T11:47:46.662 INFO:teuthology.orchestra.run.smithi188.stdout:(125/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 2.2 MB/s | 47 kB 00:00 2020-11-20T11:47:46.688 INFO:teuthology.orchestra.run.smithi188.stdout:(126/133): openssl-devel-1.1.1g-11.el8.x86_64.r 61 MB/s | 2.3 MB 00:00 2020-11-20T11:47:47.570 INFO:teuthology.orchestra.run.smithi036.stdout:(7/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 881 kB/s | 6.0 MB 00:06 2020-11-20T11:47:47.701 INFO:teuthology.orchestra.run.smithi188.stdout:(127/133): ceph-test-16.0.0-7397.gb86e691b.el8. 9.7 MB/s | 48 MB 00:04 2020-11-20T11:47:47.724 INFO:teuthology.orchestra.run.smithi188.stdout:(128/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 2.3 MB/s | 2.4 MB 00:01 2020-11-20T11:47:47.747 INFO:teuthology.orchestra.run.smithi188.stdout:(129/133): librados2-16.0.0-7397.gb86e691b.el8. 3.4 MB/s | 3.7 MB 00:01 2020-11-20T11:47:47.764 INFO:teuthology.orchestra.run.smithi188.stdout:(130/133): NetworkManager-libnm-1.26.0-9.el8_3. 28 MB/s | 1.7 MB 00:00 2020-11-20T11:47:47.766 INFO:teuthology.orchestra.run.smithi188.stdout:(131/133): NetworkManager-tui-1.26.0-9.el8_3.x8 7.5 MB/s | 320 kB 00:00 2020-11-20T11:47:47.791 INFO:teuthology.orchestra.run.smithi188.stdout:(132/133): NetworkManager-team-1.26.0-9.el8_3.x 3.5 MB/s | 141 kB 00:00 2020-11-20T11:47:47.806 INFO:teuthology.orchestra.run.smithi188.stdout:(133/133): NetworkManager-1.26.0-9.el8_3.x86_64 58 MB/s | 2.4 MB 00:00 2020-11-20T11:47:47.810 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:47:47.811 INFO:teuthology.orchestra.run.smithi188.stdout:Total 24 MB/s | 199 MB 00:08 2020-11-20T11:47:47.870 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2020-11-20T11:47:47.978 INFO:teuthology.orchestra.run.smithi036.stdout:(8/133): ceph-common-16.0.0-7397.gb86e691b.el8. 3.1 MB/s | 23 MB 00:07 2020-11-20T11:47:47.996 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2020-11-20T11:47:47.997 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2020-11-20T11:47:48.002 INFO:teuthology.orchestra.run.smithi036.stdout:(9/133): ceph-selinux-16.0.0-7397.gb86e691b.el8 1.0 MB/s | 25 kB 00:00 2020-11-20T11:47:48.300 INFO:teuthology.orchestra.run.smithi164.stdout:(8/133): ceph-radosgw-16.0.0-7397.gb86e691b.el8 3.7 MB/s | 12 MB 00:03 2020-11-20T11:47:48.328 INFO:teuthology.orchestra.run.smithi164.stdout:(9/133): ceph-selinux-16.0.0-7397.gb86e691b.el8 874 kB/s | 25 kB 00:00 2020-11-20T11:47:49.575 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2020-11-20T11:47:49.579 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2020-11-20T11:47:49.970 INFO:teuthology.orchestra.run.smithi164.stdout:(10/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 2.9 MB/s | 18 MB 00:06 2020-11-20T11:47:50.005 INFO:teuthology.orchestra.run.smithi164.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 676 kB/s | 24 kB 00:00 2020-11-20T11:47:50.160 INFO:teuthology.orchestra.run.smithi164.stdout:(12/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 3.6 MB/s | 562 kB 00:00 2020-11-20T11:47:50.199 INFO:teuthology.orchestra.run.smithi164.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 3.3 MB/s | 131 kB 00:00 2020-11-20T11:47:50.315 INFO:teuthology.orchestra.run.smithi164.stdout:(14/133): libradosstriper1-16.0.0-7397.gb86e691 4.1 MB/s | 486 kB 00:00 2020-11-20T11:47:50.416 INFO:teuthology.orchestra.run.smithi036.stdout:(10/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 4.2 MB/s | 18 MB 00:04 2020-11-20T11:47:50.456 INFO:teuthology.orchestra.run.smithi036.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 596 kB/s | 24 kB 00:00 2020-11-20T11:47:50.542 INFO:teuthology.orchestra.run.smithi036.stdout:(12/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 6.4 MB/s | 562 kB 00:00 2020-11-20T11:47:50.570 INFO:teuthology.orchestra.run.smithi036.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 4.5 MB/s | 131 kB 00:00 2020-11-20T11:47:50.578 INFO:teuthology.orchestra.run.smithi164.stdout:(15/133): ceph-common-16.0.0-7397.gb86e691b.el8 2.2 MB/s | 23 MB 00:10 2020-11-20T11:47:50.617 INFO:teuthology.orchestra.run.smithi164.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 1.0 MB/s | 40 kB 00:00 2020-11-20T11:47:50.657 INFO:teuthology.orchestra.run.smithi164.stdout:(17/133): python3-ceph-common-16.0.0-7397.gb86e 1.8 MB/s | 73 kB 00:00 2020-11-20T11:47:50.672 INFO:teuthology.orchestra.run.smithi036.stdout:(14/133): libradosstriper1-16.0.0-7397.gb86e691 4.7 MB/s | 486 kB 00:00 2020-11-20T11:47:50.733 INFO:teuthology.orchestra.run.smithi164.stdout:(18/133): python3-cephfs-16.0.0-7397.gb86e691b. 2.6 MB/s | 204 kB 00:00 2020-11-20T11:47:50.773 INFO:teuthology.orchestra.run.smithi036.stdout:(15/133): ceph-radosgw-16.0.0-7397.gb86e691b.el 3.7 MB/s | 12 MB 00:03 2020-11-20T11:47:50.812 INFO:teuthology.orchestra.run.smithi036.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 1.0 MB/s | 40 kB 00:00 2020-11-20T11:47:50.826 INFO:teuthology.orchestra.run.smithi164.stdout:(19/133): python3-rados-16.0.0-7397.gb86e691b.e 3.9 MB/s | 375 kB 00:00 2020-11-20T11:47:50.848 INFO:teuthology.orchestra.run.smithi036.stdout:(17/133): python3-ceph-common-16.0.0-7397.gb86e 2.1 MB/s | 73 kB 00:00 2020-11-20T11:47:50.909 INFO:teuthology.orchestra.run.smithi164.stdout:(20/133): python3-rbd-16.0.0-7397.gb86e691b.el8 4.2 MB/s | 353 kB 00:00 2020-11-20T11:47:50.926 INFO:teuthology.orchestra.run.smithi036.stdout:(18/133): python3-cephfs-16.0.0-7397.gb86e691b. 2.5 MB/s | 204 kB 00:00 2020-11-20T11:47:50.944 INFO:teuthology.orchestra.run.smithi164.stdout:(21/133): python3-rgw-16.0.0-7397.gb86e691b.el8 3.1 MB/s | 113 kB 00:00 2020-11-20T11:47:50.985 INFO:teuthology.orchestra.run.smithi164.stdout:(22/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 2.1 MB/s | 88 kB 00:00 2020-11-20T11:47:51.008 INFO:teuthology.orchestra.run.smithi036.stdout:(19/133): python3-rados-16.0.0-7397.gb86e691b.e 4.5 MB/s | 375 kB 00:00 2020-11-20T11:47:51.070 INFO:teuthology.orchestra.run.smithi164.stdout:(23/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 4.9 MB/s | 3.7 MB 00:00 2020-11-20T11:47:51.091 INFO:teuthology.orchestra.run.smithi036.stdout:(20/133): python3-rbd-16.0.0-7397.gb86e691b.el8 4.2 MB/s | 353 kB 00:00 2020-11-20T11:47:51.113 INFO:teuthology.orchestra.run.smithi164.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 3.9 MB/s | 171 kB 00:00 2020-11-20T11:47:51.132 INFO:teuthology.orchestra.run.smithi036.stdout:(21/133): python3-rgw-16.0.0-7397.gb86e691b.el8 2.7 MB/s | 113 kB 00:00 2020-11-20T11:47:51.148 INFO:teuthology.orchestra.run.smithi164.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 679 kB/s | 24 kB 00:00 2020-11-20T11:47:51.166 INFO:teuthology.orchestra.run.smithi036.stdout:(22/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 2.5 MB/s | 88 kB 00:00 2020-11-20T11:47:51.184 INFO:teuthology.orchestra.run.smithi164.stdout:(26/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.8 MB/s | 66 kB 00:00 2020-11-20T11:47:51.421 INFO:teuthology.orchestra.run.smithi036.stdout:(23/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 5.0 MB/s | 3.7 MB 00:00 2020-11-20T11:47:51.465 INFO:teuthology.orchestra.run.smithi036.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 3.8 MB/s | 171 kB 00:00 2020-11-20T11:47:51.505 INFO:teuthology.orchestra.run.smithi036.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 615 kB/s | 24 kB 00:00 2020-11-20T11:47:51.546 INFO:teuthology.orchestra.run.smithi036.stdout:(26/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.6 MB/s | 66 kB 00:00 2020-11-20T11:47:51.752 INFO:teuthology.orchestra.run.smithi164.stdout:(27/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 4.2 MB/s | 3.2 MB 00:00 2020-11-20T11:47:51.786 INFO:teuthology.orchestra.run.smithi036.stdout:(27/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 5.1 MB/s | 3.2 MB 00:00 2020-11-20T11:47:51.894 INFO:teuthology.orchestra.run.smithi164.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 4.5 MB/s | 3.2 MB 00:00 2020-11-20T11:47:51.944 INFO:teuthology.orchestra.run.smithi164.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 3.9 MB/s | 198 kB 00:00 2020-11-20T11:47:51.988 INFO:teuthology.orchestra.run.smithi164.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 629 kB/s | 27 kB 00:00 2020-11-20T11:47:52.032 INFO:teuthology.orchestra.run.smithi164.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 207 kB/s | 8.8 kB 00:00 2020-11-20T11:47:52.076 INFO:teuthology.orchestra.run.smithi164.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 1.3 MB/s | 57 kB 00:00 2020-11-20T11:47:52.173 INFO:teuthology.orchestra.run.smithi164.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-20T11:47:52.179 INFO:teuthology.orchestra.run.smithi036.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 5.0 MB/s | 3.2 MB 00:00 2020-11-20T11:47:52.214 INFO:teuthology.orchestra.run.smithi164.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 7.7 MB/s | 315 kB 00:00 2020-11-20T11:47:52.224 INFO:teuthology.orchestra.run.smithi036.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 4.5 MB/s | 198 kB 00:00 2020-11-20T11:47:52.235 INFO:teuthology.orchestra.run.smithi164.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 8.5 MB/s | 181 kB 00:00 2020-11-20T11:47:52.255 INFO:teuthology.orchestra.run.smithi164.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2020-11-20T11:47:52.260 INFO:teuthology.orchestra.run.smithi036.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 741 kB/s | 27 kB 00:00 2020-11-20T11:47:52.275 INFO:teuthology.orchestra.run.smithi164.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 3.6 MB/s | 75 kB 00:00 2020-11-20T11:47:52.295 INFO:teuthology.orchestra.run.smithi164.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.0 MB/s | 21 kB 00:00 2020-11-20T11:47:52.296 INFO:teuthology.orchestra.run.smithi036.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 243 kB/s | 8.8 kB 00:00 2020-11-20T11:47:52.315 INFO:teuthology.orchestra.run.smithi164.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.1 MB/s | 44 kB 00:00 2020-11-20T11:47:52.335 INFO:teuthology.orchestra.run.smithi036.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 1.5 MB/s | 57 kB 00:00 2020-11-20T11:47:52.336 INFO:teuthology.orchestra.run.smithi164.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 8.7 MB/s | 185 kB 00:00 2020-11-20T11:47:52.356 INFO:teuthology.orchestra.run.smithi164.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2020-11-20T11:47:52.376 INFO:teuthology.orchestra.run.smithi164.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 829 kB/s | 16 kB 00:00 2020-11-20T11:47:52.397 INFO:teuthology.orchestra.run.smithi164.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 6.9 MB/s | 145 kB 00:00 2020-11-20T11:47:52.420 INFO:teuthology.orchestra.run.smithi164.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 17 MB/s | 384 kB 00:00 2020-11-20T11:47:52.433 INFO:teuthology.orchestra.run.smithi036.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-20T11:47:52.440 INFO:teuthology.orchestra.run.smithi164.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.0 MB/s | 40 kB 00:00 2020-11-20T11:47:52.464 INFO:teuthology.orchestra.run.smithi164.stdout:(46/133): python3-execnet-1.7.1-1.el8.noarch.rp 14 MB/s | 355 kB 00:00 2020-11-20T11:47:52.473 INFO:teuthology.orchestra.run.smithi036.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 7.7 MB/s | 315 kB 00:00 2020-11-20T11:47:52.484 INFO:teuthology.orchestra.run.smithi164.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 3.9 MB/s | 81 kB 00:00 2020-11-20T11:47:52.494 INFO:teuthology.orchestra.run.smithi036.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 8.5 MB/s | 181 kB 00:00 2020-11-20T11:47:52.505 INFO:teuthology.orchestra.run.smithi164.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 564 kB/s | 11 kB 00:00 2020-11-20T11:47:52.514 INFO:teuthology.orchestra.run.smithi036.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2020-11-20T11:47:52.524 INFO:teuthology.orchestra.run.smithi164.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 893 kB/s | 18 kB 00:00 2020-11-20T11:47:52.534 INFO:teuthology.orchestra.run.smithi036.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2020-11-20T11:47:52.554 INFO:teuthology.orchestra.run.smithi036.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-11-20T11:47:52.575 INFO:teuthology.orchestra.run.smithi036.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.0 MB/s | 44 kB 00:00 2020-11-20T11:47:52.587 INFO:teuthology.orchestra.run.smithi164.stdout:(50/133): python3-kubernetes-11.0.0-2.el8.noarc 19 MB/s | 1.2 MB 00:00 2020-11-20T11:47:52.596 INFO:teuthology.orchestra.run.smithi036.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 8.6 MB/s | 185 kB 00:00 2020-11-20T11:47:52.606 INFO:teuthology.orchestra.run.smithi164.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2020-11-20T11:47:52.616 INFO:teuthology.orchestra.run.smithi036.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2020-11-20T11:47:52.626 INFO:teuthology.orchestra.run.smithi164.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 2.8 MB/s | 59 kB 00:00 2020-11-20T11:47:52.636 INFO:teuthology.orchestra.run.smithi036.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 825 kB/s | 16 kB 00:00 2020-11-20T11:47:52.648 INFO:teuthology.orchestra.run.smithi164.stdout:(53/133): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-11-20T11:47:52.658 INFO:teuthology.orchestra.run.smithi036.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 6.7 MB/s | 145 kB 00:00 2020-11-20T11:47:52.668 INFO:teuthology.orchestra.run.smithi164.stdout:(54/133): python3-portend-2.6-1.el8.noarch.rpm 793 kB/s | 16 kB 00:00 2020-11-20T11:47:52.688 INFO:teuthology.orchestra.run.smithi164.stdout:(55/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.3 MB/s | 48 kB 00:00 2020-11-20T11:47:52.697 INFO:teuthology.orchestra.run.smithi036.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 9.5 MB/s | 384 kB 00:00 2020-11-20T11:47:52.708 INFO:teuthology.orchestra.run.smithi164.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 1.6 MB/s | 34 kB 00:00 2020-11-20T11:47:52.717 INFO:teuthology.orchestra.run.smithi036.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.0 MB/s | 40 kB 00:00 2020-11-20T11:47:52.729 INFO:teuthology.orchestra.run.smithi164.stdout:(57/133): python3-routes-2.4.1-12.el8.noarch.rp 9.2 MB/s | 196 kB 00:00 2020-11-20T11:47:52.739 INFO:teuthology.orchestra.run.smithi036.stdout:(46/133): python3-execnet-1.7.1-1.el8.noarch.rp 16 MB/s | 355 kB 00:00 2020-11-20T11:47:52.749 INFO:teuthology.orchestra.run.smithi164.stdout:(58/133): python3-rsa-3.4.2-15.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2020-11-20T11:47:52.761 INFO:teuthology.orchestra.run.smithi036.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 3.9 MB/s | 81 kB 00:00 2020-11-20T11:47:52.769 INFO:teuthology.orchestra.run.smithi164.stdout:(59/133): python3-simplegeneric-0.8.1-17.el8.no 955 kB/s | 19 kB 00:00 2020-11-20T11:47:52.781 INFO:teuthology.orchestra.run.smithi036.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 570 kB/s | 11 kB 00:00 2020-11-20T11:47:52.789 INFO:teuthology.orchestra.run.smithi164.stdout:(60/133): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2020-11-20T11:47:52.800 INFO:teuthology.orchestra.run.smithi036.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 878 kB/s | 18 kB 00:00 2020-11-20T11:47:52.809 INFO:teuthology.orchestra.run.smithi164.stdout:(61/133): python3-tempora-1.14.1-5.el8.noarch.r 1.4 MB/s | 29 kB 00:00 2020-11-20T11:47:52.830 INFO:teuthology.orchestra.run.smithi164.stdout:(62/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.3 MB/s | 27 kB 00:00 2020-11-20T11:47:52.852 INFO:teuthology.orchestra.run.smithi164.stdout:(63/133): python3-waitress-1.2.1-2.el8.1.noarch 11 MB/s | 241 kB 00:00 2020-11-20T11:47:52.862 INFO:teuthology.orchestra.run.smithi036.stdout:(50/133): python3-kubernetes-11.0.0-2.el8.noarc 19 MB/s | 1.2 MB 00:00 2020-11-20T11:47:52.873 INFO:teuthology.orchestra.run.smithi164.stdout:(64/133): python3-webob-1.8.5-1.el8.1.noarch.rp 12 MB/s | 251 kB 00:00 2020-11-20T11:47:52.882 INFO:teuthology.orchestra.run.smithi036.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2020-11-20T11:47:52.892 INFO:teuthology.orchestra.run.smithi164.stdout:(65/133): python3-websocket-client-0.56.0-5.el8 3.0 MB/s | 61 kB 00:00 2020-11-20T11:47:52.902 INFO:teuthology.orchestra.run.smithi036.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 2.9 MB/s | 59 kB 00:00 2020-11-20T11:47:52.913 INFO:teuthology.orchestra.run.smithi164.stdout:(66/133): python3-webtest-2.0.33-1.el8.noarch.r 4.1 MB/s | 85 kB 00:00 2020-11-20T11:47:52.933 INFO:teuthology.orchestra.run.smithi164.stdout:(67/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.1 MB/s | 23 kB 00:00 2020-11-20T11:47:52.940 INFO:teuthology.orchestra.run.smithi036.stdout:(53/133): ceph-mgr-diskprediction-local-16.0.0- 7.4 MB/s | 8.6 MB 00:01 2020-11-20T11:47:52.942 INFO:teuthology.orchestra.run.smithi036.stdout:(54/133): python3-pecan-1.3.2-9.el8.noarch.rpm 6.9 MB/s | 283 kB 00:00 2020-11-20T11:47:52.953 INFO:teuthology.orchestra.run.smithi164.stdout:(68/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.4 MB/s | 69 kB 00:00 2020-11-20T11:47:52.963 INFO:teuthology.orchestra.run.smithi036.stdout:(55/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.3 MB/s | 48 kB 00:00 2020-11-20T11:47:52.983 INFO:teuthology.orchestra.run.smithi036.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 1.6 MB/s | 34 kB 00:00 2020-11-20T11:47:52.987 INFO:teuthology.orchestra.run.smithi164.stdout:(69/133): automake-1.16.1-6.el8.noarch.rpm 21 MB/s | 713 kB 00:00 2020-11-20T11:47:52.999 INFO:teuthology.orchestra.run.smithi036.stdout:(57/133): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2020-11-20T11:47:53.004 INFO:teuthology.orchestra.run.smithi036.stdout:(58/133): python3-routes-2.4.1-12.el8.noarch.rp 9.1 MB/s | 196 kB 00:00 2020-11-20T11:47:53.006 INFO:teuthology.orchestra.run.smithi164.stdout:(70/133): python3-webencodings-0.5.1-6.el8.noar 1.4 MB/s | 27 kB 00:00 2020-11-20T11:47:53.024 INFO:teuthology.orchestra.run.smithi036.stdout:(59/133): python3-simplegeneric-0.8.1-17.el8.no 946 kB/s | 19 kB 00:00 2020-11-20T11:47:53.037 INFO:teuthology.orchestra.run.smithi164.stdout:(71/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 50 MB/s | 1.5 MB 00:00 2020-11-20T11:47:53.038 INFO:teuthology.orchestra.run.smithi036.stdout:(60/133): python3-rsa-3.4.2-15.el8.noarch.rpm 1.8 MB/s | 73 kB 00:00 2020-11-20T11:47:53.044 INFO:teuthology.orchestra.run.smithi036.stdout:(61/133): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2020-11-20T11:47:53.059 INFO:teuthology.orchestra.run.smithi164.stdout:(72/133): jq-1.5-12.el8.x86_64.rpm 7.5 MB/s | 161 kB 00:00 2020-11-20T11:47:53.060 INFO:teuthology.orchestra.run.smithi036.stdout:(62/133): python3-tempora-1.14.1-5.el8.noarch.r 1.4 MB/s | 29 kB 00:00 2020-11-20T11:47:53.065 INFO:teuthology.orchestra.run.smithi036.stdout:(63/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.3 MB/s | 27 kB 00:00 2020-11-20T11:47:53.079 INFO:teuthology.orchestra.run.smithi164.stdout:(73/133): python3-pyOpenSSL-18.0.0-1.el8.noarch 4.8 MB/s | 103 kB 00:00 2020-11-20T11:47:53.086 INFO:teuthology.orchestra.run.smithi036.stdout:(64/133): python3-webob-1.8.5-1.el8.1.noarch.rp 11 MB/s | 251 kB 00:00 2020-11-20T11:47:53.103 INFO:teuthology.orchestra.run.smithi164.stdout:(74/133): python3-werkzeug-0.12.2-4.el8.noarch. 19 MB/s | 457 kB 00:00 2020-11-20T11:47:53.106 INFO:teuthology.orchestra.run.smithi036.stdout:(65/133): python3-websocket-client-0.56.0-5.el8 3.0 MB/s | 61 kB 00:00 2020-11-20T11:47:53.117 INFO:teuthology.orchestra.run.smithi036.stdout:(66/133): python3-waitress-1.2.1-2.el8.1.noarch 4.0 MB/s | 241 kB 00:00 2020-11-20T11:47:53.126 INFO:teuthology.orchestra.run.smithi036.stdout:(67/133): python3-webtest-2.0.33-1.el8.noarch.r 4.2 MB/s | 85 kB 00:00 2020-11-20T11:47:53.137 INFO:teuthology.orchestra.run.smithi036.stdout:(68/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.1 MB/s | 23 kB 00:00 2020-11-20T11:47:53.142 INFO:teuthology.orchestra.run.smithi164.stdout:(75/133): ceph-mgr-diskprediction-local-16.0.0- 6.2 MB/s | 8.6 MB 00:01 2020-11-20T11:47:53.144 INFO:teuthology.orchestra.run.smithi164.stdout:(76/133): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2020-11-20T11:47:53.150 INFO:teuthology.orchestra.run.smithi036.stdout:(69/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.0 MB/s | 69 kB 00:00 2020-11-20T11:47:53.174 INFO:teuthology.orchestra.run.smithi164.stdout:(77/133): python3-jsonpointer-1.10-11.el8.noarc 841 kB/s | 20 kB 00:00 2020-11-20T11:47:53.180 INFO:teuthology.orchestra.run.smithi164.stdout:(78/133): python3-jsonpatch-1.21-2.el8.noarch.r 702 kB/s | 27 kB 00:00 2020-11-20T11:47:53.185 INFO:teuthology.orchestra.run.smithi036.stdout:(70/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.8 MB/s | 238 kB 00:00 2020-11-20T11:47:53.198 INFO:teuthology.orchestra.run.smithi164.stdout:(79/133): python3-html5lib-0.999999999-6.el8.no 8.5 MB/s | 214 kB 00:00 2020-11-20T11:47:53.201 INFO:teuthology.orchestra.run.smithi036.stdout:(71/133): libverto-devel-0.3.0-5.el8.x86_64.rpm 343 kB/s | 18 kB 00:00 2020-11-20T11:47:53.206 INFO:teuthology.orchestra.run.smithi164.stdout:(80/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.8 MB/s | 126 kB 00:00 2020-11-20T11:47:53.219 INFO:teuthology.orchestra.run.smithi036.stdout:(72/133): python3-asn1crypto-0.24.0-3.el8.noarc 5.3 MB/s | 181 kB 00:00 2020-11-20T11:47:53.222 INFO:teuthology.orchestra.run.smithi164.stdout:(81/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.2 MB/s | 54 kB 00:00 2020-11-20T11:47:53.232 INFO:teuthology.orchestra.run.smithi164.stdout:(82/133): python3-pyasn1-modules-0.3.7-6.el8.no 4.1 MB/s | 110 kB 00:00 2020-11-20T11:47:53.236 INFO:teuthology.orchestra.run.smithi036.stdout:(73/133): python3-requests-oauthlib-1.0.0-1.el8 1.2 MB/s | 43 kB 00:00 2020-11-20T11:47:53.249 INFO:teuthology.orchestra.run.smithi164.stdout:(83/133): python3-prettytable-0.7.2-14.el8.noar 1.6 MB/s | 44 kB 00:00 2020-11-20T11:47:53.252 INFO:teuthology.orchestra.run.smithi036.stdout:(74/133): fuse-2.9.7-12.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2020-11-20T11:47:53.257 INFO:teuthology.orchestra.run.smithi164.stdout:(84/133): python3-markupsafe-0.23-19.el8.x86_64 1.6 MB/s | 39 kB 00:00 2020-11-20T11:47:53.269 INFO:teuthology.orchestra.run.smithi036.stdout:(75/133): python3-pycparser-2.14-14.el8.noarch. 3.2 MB/s | 109 kB 00:00 2020-11-20T11:47:53.276 INFO:teuthology.orchestra.run.smithi164.stdout:(85/133): flex-2.6.1-9.el8.x86_64.rpm 12 MB/s | 320 kB 00:00 2020-11-20T11:47:53.285 INFO:teuthology.orchestra.run.smithi164.stdout:(86/133): librdkafka-0.11.4-1.el8.x86_64.rpm 12 MB/s | 353 kB 00:00 2020-11-20T11:47:53.285 INFO:teuthology.orchestra.run.smithi036.stdout:(76/133): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.4 MB/s | 48 kB 00:00 2020-11-20T11:47:53.301 INFO:teuthology.orchestra.run.smithi036.stdout:(77/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2020-11-20T11:47:53.304 INFO:teuthology.orchestra.run.smithi164.stdout:(87/133): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2020-11-20T11:47:53.318 INFO:teuthology.orchestra.run.smithi036.stdout:(78/133): python3-oauthlib-2.1.0-1.el8.noarch.r 4.6 MB/s | 155 kB 00:00 2020-11-20T11:47:53.320 INFO:teuthology.orchestra.run.smithi164.stdout:(88/133): libtool-2.4.6-25.el8.x86_64.rpm 20 MB/s | 709 kB 00:00 2020-11-20T11:47:53.334 INFO:teuthology.orchestra.run.smithi164.stdout:(89/133): python3-jinja2-2.10.1-2.el8_0.noarch. 18 MB/s | 538 kB 00:00 2020-11-20T11:47:53.342 INFO:teuthology.orchestra.run.smithi036.stdout:(79/133): fuse-common-3.2.1-12.el8.x86_64.rpm 510 kB/s | 21 kB 00:00 2020-11-20T11:47:53.352 INFO:teuthology.orchestra.run.smithi036.stdout:(80/133): libsepol-devel-2.9-1.el8.x86_64.rpm 2.5 MB/s | 86 kB 00:00 2020-11-20T11:47:53.358 INFO:teuthology.orchestra.run.smithi164.stdout:(90/133): python3-numpy-f2py-1.14.3-9.el8.x86_6 9.5 MB/s | 225 kB 00:00 2020-11-20T11:47:53.368 INFO:teuthology.orchestra.run.smithi036.stdout:(81/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 745 kB/s | 19 kB 00:00 2020-11-20T11:47:53.385 INFO:teuthology.orchestra.run.smithi036.stdout:(82/133): libselinux-devel-2.9-3.el8.x86_64.rpm 6.0 MB/s | 199 kB 00:00 2020-11-20T11:47:53.411 INFO:teuthology.orchestra.run.smithi036.stdout:(83/133): python3-cryptography-2.3-3.el8.x86_64 12 MB/s | 511 kB 00:00 2020-11-20T11:47:53.421 INFO:teuthology.orchestra.run.smithi164.stdout:(91/133): python3-babel-2.5.1-5.el8.noarch.rpm 77 MB/s | 4.8 MB 00:00 2020-11-20T11:47:53.422 INFO:teuthology.orchestra.run.smithi036.stdout:(84/133): zlib-devel-1.2.11-16.el8_2.x86_64.rpm 1.5 MB/s | 57 kB 00:00 2020-11-20T11:47:53.441 INFO:teuthology.orchestra.run.smithi036.stdout:(85/133): libuuid-devel-2.32.1-24.el8.x86_64.rp 3.2 MB/s | 96 kB 00:00 2020-11-20T11:47:53.443 INFO:teuthology.orchestra.run.smithi164.stdout:(92/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2020-11-20T11:47:53.459 INFO:teuthology.orchestra.run.smithi036.stdout:(86/133): libxslt-1.1.32-5.el8.x86_64.rpm 6.7 MB/s | 250 kB 00:00 2020-11-20T11:47:53.488 INFO:teuthology.orchestra.run.smithi036.stdout:(87/133): libcom_err-devel-1.45.6-1.el8.x86_64. 810 kB/s | 38 kB 00:00 2020-11-20T11:47:53.499 INFO:teuthology.orchestra.run.smithi036.stdout:(88/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 4.9 MB/s | 169 kB 00:00 2020-11-20T11:47:53.528 INFO:teuthology.orchestra.run.smithi036.stdout:(89/133): pcre2-devel-10.32-2.el8.x86_64.rpm 15 MB/s | 605 kB 00:00 2020-11-20T11:47:53.548 INFO:teuthology.orchestra.run.smithi036.stdout:(90/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 13 MB/s | 639 kB 00:00 2020-11-20T11:47:53.553 INFO:teuthology.orchestra.run.smithi164.stdout:(93/133): python3-scipy-1.0.0-20.module+el8.1.0 63 MB/s | 15 MB 00:00 2020-11-20T11:47:53.557 INFO:teuthology.orchestra.run.smithi036.stdout:(91/133): elfutils-libelf-devel-0.180-1.el8.x86 1.9 MB/s | 58 kB 00:00 2020-11-20T11:47:53.575 INFO:teuthology.orchestra.run.smithi036.stdout:(92/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.0 MB/s | 220 kB 00:00 2020-11-20T11:47:53.591 INFO:teuthology.orchestra.run.smithi164.stdout:(94/133): python3-numpy-1.14.3-9.el8.x86_64.rpm 25 MB/s | 3.7 MB 00:00 2020-11-20T11:47:53.592 INFO:teuthology.orchestra.run.smithi036.stdout:(93/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.5 MB/s | 229 kB 00:00 2020-11-20T11:47:53.612 INFO:teuthology.orchestra.run.smithi036.stdout:(94/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 15 MB/s | 558 kB 00:00 2020-11-20T11:47:53.624 INFO:teuthology.orchestra.run.smithi164.stdout:(95/133): openblas-threads-0.3.3-5.el8.x86_64.r 61 MB/s | 4.4 MB 00:00 2020-11-20T11:47:53.629 INFO:teuthology.orchestra.run.smithi036.stdout:(95/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rpm 1.8 MB/s | 69 kB 00:00 2020-11-20T11:47:53.645 INFO:teuthology.orchestra.run.smithi036.stdout:(96/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2020-11-20T11:47:53.648 INFO:teuthology.orchestra.run.smithi164.stdout:(96/133): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2020-11-20T11:47:53.666 INFO:teuthology.orchestra.run.smithi164.stdout:(97/133): openblas-0.3.3-5.el8.x86_64.rpm 57 MB/s | 4.3 MB 00:00 2020-11-20T11:47:53.683 INFO:teuthology.orchestra.run.smithi164.stdout:(98/133): oniguruma-6.8.2-2.el8.x86_64.rpm 5.2 MB/s | 187 kB 00:00 2020-11-20T11:47:53.684 INFO:teuthology.orchestra.run.smithi036.stdout:(97/133): openssl-devel-1.1.1g-11.el8.x86_64.rp 42 MB/s | 2.3 MB 00:00 2020-11-20T11:47:53.691 INFO:teuthology.orchestra.run.smithi164.stdout:(99/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.4 MB/s | 238 kB 00:00 2020-11-20T11:47:53.695 INFO:teuthology.orchestra.run.smithi036.stdout:(98/133): automake-1.16.1-6.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2020-11-20T11:47:53.705 INFO:teuthology.orchestra.run.smithi164.stdout:(100/133): libverto-devel-0.3.0-5.el8.x86_64.rp 913 kB/s | 18 kB 00:00 2020-11-20T11:47:53.711 INFO:teuthology.orchestra.run.smithi036.stdout:(99/133): python3-webencodings-0.5.1-6.el8.noar 1.0 MB/s | 27 kB 00:00 2020-11-20T11:47:53.715 INFO:teuthology.orchestra.run.smithi164.stdout:(101/133): python3-asn1crypto-0.24.0-3.el8.noar 7.2 MB/s | 181 kB 00:00 2020-11-20T11:47:53.728 INFO:teuthology.orchestra.run.smithi164.stdout:(102/133): python3-requests-oauthlib-1.0.0-1.el 1.6 MB/s | 43 kB 00:00 2020-11-20T11:47:53.739 INFO:teuthology.orchestra.run.smithi164.stdout:(103/133): fuse-2.9.7-12.el8.x86_64.rpm 4.2 MB/s | 83 kB 00:00 2020-11-20T11:47:53.749 INFO:teuthology.orchestra.run.smithi036.stdout:(100/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 28 MB/s | 1.5 MB 00:00 2020-11-20T11:47:53.751 INFO:teuthology.orchestra.run.smithi036.stdout:(101/133): jq-1.5-12.el8.x86_64.rpm 4.0 MB/s | 161 kB 00:00 2020-11-20T11:47:53.756 INFO:teuthology.orchestra.run.smithi164.stdout:(104/133): python3-pycparser-2.14-14.el8.noarch 3.8 MB/s | 109 kB 00:00 2020-11-20T11:47:53.763 INFO:teuthology.orchestra.run.smithi164.stdout:(105/133): keyutils-libs-devel-1.5.10-6.el8.x86 1.9 MB/s | 48 kB 00:00 2020-11-20T11:47:53.781 INFO:teuthology.orchestra.run.smithi164.stdout:(106/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2020-11-20T11:47:53.783 INFO:teuthology.orchestra.run.smithi036.stdout:(102/133): python3-pyOpenSSL-18.0.0-1.el8.noarc 3.0 MB/s | 103 kB 00:00 2020-11-20T11:47:53.795 INFO:teuthology.orchestra.run.smithi164.stdout:(107/133): python3-oauthlib-2.1.0-1.el8.noarch. 4.8 MB/s | 155 kB 00:00 2020-11-20T11:47:53.801 INFO:teuthology.orchestra.run.smithi164.stdout:(108/133): fuse-common-3.2.1-12.el8.x86_64.rpm 1.0 MB/s | 21 kB 00:00 2020-11-20T11:47:53.804 INFO:teuthology.orchestra.run.smithi036.stdout:(103/133): python3-werkzeug-0.12.2-4.el8.noarch 8.5 MB/s | 457 kB 00:00 2020-11-20T11:47:53.822 INFO:teuthology.orchestra.run.smithi164.stdout:(109/133): libsepol-devel-2.9-1.el8.x86_64.rpm 3.1 MB/s | 86 kB 00:00 2020-11-20T11:47:53.823 INFO:teuthology.orchestra.run.smithi036.stdout:(104/133): python3-mako-1.0.6-13.el8.noarch.rpm 3.9 MB/s | 157 kB 00:00 2020-11-20T11:47:53.829 INFO:teuthology.orchestra.run.smithi164.stdout:(110/133): libaio-devel-0.3.112-1.el8.x86_64.rp 688 kB/s | 19 kB 00:00 2020-11-20T11:47:53.833 INFO:teuthology.orchestra.run.smithi036.stdout:(105/133): python3-jsonpatch-1.21-2.el8.noarch. 906 kB/s | 27 kB 00:00 2020-11-20T11:47:53.847 INFO:teuthology.orchestra.run.smithi164.stdout:(111/133): libselinux-devel-2.9-3.el8.x86_64.rp 7.8 MB/s | 199 kB 00:00 2020-11-20T11:47:53.849 INFO:teuthology.orchestra.run.smithi036.stdout:(106/133): python3-jsonpointer-1.10-11.el8.noar 768 kB/s | 20 kB 00:00 2020-11-20T11:47:53.858 INFO:teuthology.orchestra.run.smithi164.stdout:(112/133): python3-cryptography-2.3-3.el8.x86_6 17 MB/s | 511 kB 00:00 2020-11-20T11:47:53.867 INFO:teuthology.orchestra.run.smithi036.stdout:(107/133): python3-html5lib-0.999999999-6.el8.n 6.3 MB/s | 214 kB 00:00 2020-11-20T11:47:53.871 INFO:teuthology.orchestra.run.smithi164.stdout:(113/133): zlib-devel-1.2.11-16.el8_2.x86_64.rp 2.4 MB/s | 57 kB 00:00 2020-11-20T11:47:53.883 INFO:teuthology.orchestra.run.smithi036.stdout:(108/133): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.7 MB/s | 126 kB 00:00 2020-11-20T11:47:53.883 INFO:teuthology.orchestra.run.smithi164.stdout:(114/133): libuuid-devel-2.32.1-24.el8.x86_64.r 4.4 MB/s | 96 kB 00:00 2020-11-20T11:47:53.902 INFO:teuthology.orchestra.run.smithi164.stdout:(115/133): libxslt-1.1.32-5.el8.x86_64.rpm 7.8 MB/s | 250 kB 00:00 2020-11-20T11:47:53.907 INFO:teuthology.orchestra.run.smithi036.stdout:(109/133): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2020-11-20T11:47:53.909 INFO:teuthology.orchestra.run.smithi164.stdout:(116/133): libcom_err-devel-1.45.6-1.el8.x86_64 1.5 MB/s | 38 kB 00:00 2020-11-20T11:47:53.917 INFO:teuthology.orchestra.run.smithi036.stdout:(110/133): python3-pyasn1-modules-0.3.7-6.el8.n 3.2 MB/s | 110 kB 00:00 2020-11-20T11:47:53.929 INFO:teuthology.orchestra.run.smithi164.stdout:(117/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 6.3 MB/s | 169 kB 00:00 2020-11-20T11:47:53.932 INFO:teuthology.orchestra.run.smithi036.stdout:(111/133): python3-prettytable-0.7.2-14.el8.noa 1.7 MB/s | 44 kB 00:00 2020-11-20T11:47:53.943 INFO:teuthology.orchestra.run.smithi164.stdout:(118/133): pcre2-devel-10.32-2.el8.x86_64.rpm 17 MB/s | 605 kB 00:00 2020-11-20T11:47:53.949 INFO:teuthology.orchestra.run.smithi036.stdout:(112/133): python3-markupsafe-0.23-19.el8.x86_6 1.2 MB/s | 39 kB 00:00 2020-11-20T11:47:53.958 INFO:teuthology.orchestra.run.smithi164.stdout:(119/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 21 MB/s | 639 kB 00:00 2020-11-20T11:47:53.968 INFO:teuthology.orchestra.run.smithi164.stdout:(120/133): elfutils-libelf-devel-0.180-1.el8.x8 2.3 MB/s | 58 kB 00:00 2020-11-20T11:47:53.968 INFO:teuthology.orchestra.run.smithi036.stdout:(113/133): flex-2.6.1-9.el8.x86_64.rpm 8.8 MB/s | 320 kB 00:00 2020-11-20T11:47:53.986 INFO:teuthology.orchestra.run.smithi164.stdout:(121/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.9 MB/s | 220 kB 00:00 2020-11-20T11:47:53.996 INFO:teuthology.orchestra.run.smithi164.stdout:(122/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.4 MB/s | 229 kB 00:00 2020-11-20T11:47:53.997 INFO:teuthology.orchestra.run.smithi036.stdout:(114/133): librdkafka-0.11.4-1.el8.x86_64.rpm 7.4 MB/s | 353 kB 00:00 2020-11-20T11:47:54.010 INFO:teuthology.orchestra.run.smithi164.stdout:(123/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 23 MB/s | 558 kB 00:00 2020-11-20T11:47:54.016 INFO:teuthology.orchestra.run.smithi036.stdout:(115/133): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2020-11-20T11:47:54.021 INFO:teuthology.orchestra.run.smithi164.stdout:(124/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rp 3.2 MB/s | 69 kB 00:00 2020-11-20T11:47:54.030 INFO:teuthology.orchestra.run.smithi036.stdout:(116/133): libtool-2.4.6-25.el8.x86_64.rpm 20 MB/s | 709 kB 00:00 2020-11-20T11:47:54.034 INFO:teuthology.orchestra.run.smithi164.stdout:(125/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 2.4 MB/s | 47 kB 00:00 2020-11-20T11:47:54.067 INFO:teuthology.orchestra.run.smithi164.stdout:(126/133): openssl-devel-1.1.1g-11.el8.x86_64.r 52 MB/s | 2.3 MB 00:00 2020-11-20T11:47:54.382 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2020-11-20T11:47:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:(127/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 7.4 MB/s | 2.4 MB 00:00 2020-11-20T11:47:54.424 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T11:47:54.426 INFO:teuthology.orchestra.run.smithi164.stdout:(128/133): NetworkManager-libnm-1.26.0-9.el8_3. 55 MB/s | 1.7 MB 00:00 2020-11-20T11:47:54.431 INFO:teuthology.orchestra.run.smithi036.stdout:(117/133): ceph-test-16.0.0-7397.gb86e691b.el8. 7.4 MB/s | 48 MB 00:06 2020-11-20T11:47:54.447 INFO:teuthology.orchestra.run.smithi164.stdout:(129/133): NetworkManager-tui-1.26.0-9.el8_3.x8 15 MB/s | 320 kB 00:00 2020-11-20T11:47:54.460 INFO:teuthology.orchestra.run.smithi036.stdout:(118/133): python3-jinja2-2.10.1-2.el8_0.noarch 1.2 MB/s | 538 kB 00:00 2020-11-20T11:47:54.467 INFO:teuthology.orchestra.run.smithi164.stdout:(130/133): NetworkManager-team-1.26.0-9.el8_3.x 7.1 MB/s | 141 kB 00:00 2020-11-20T11:47:54.477 INFO:teuthology.orchestra.run.smithi036.stdout:(119/133): python3-numpy-f2py-1.14.3-9.el8.x86_ 4.7 MB/s | 225 kB 00:00 2020-11-20T11:47:54.502 INFO:teuthology.orchestra.run.smithi164.stdout:(131/133): NetworkManager-1.26.0-9.el8_3.x86_64 69 MB/s | 2.4 MB 00:00 2020-11-20T11:47:54.513 INFO:teuthology.orchestra.run.smithi036.stdout:(120/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 9.1 MB/s | 259 kB 00:00 2020-11-20T11:47:54.513 INFO:teuthology.orchestra.run.smithi164.stdout:(132/133): librados2-16.0.0-7397.gb86e691b.el8. 7.8 MB/s | 3.7 MB 00:00 2020-11-20T11:47:54.566 INFO:teuthology.orchestra.run.smithi036.stdout:(121/133): python3-babel-2.5.1-5.el8.noarch.rpm 45 MB/s | 4.8 MB 00:00 2020-11-20T11:47:54.595 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T11:47:54.602 INFO:teuthology.orchestra.run.smithi036.stdout:(122/133): python3-numpy-1.14.3-9.el8.x86_64.rp 42 MB/s | 3.7 MB 00:00 2020-11-20T11:47:54.660 INFO:teuthology.orchestra.run.smithi036.stdout:(123/133): openblas-threads-0.3.3-5.el8.x86_64. 47 MB/s | 4.4 MB 00:00 2020-11-20T11:47:54.697 INFO:teuthology.orchestra.run.smithi036.stdout:(124/133): openblas-0.3.3-5.el8.x86_64.rpm 45 MB/s | 4.3 MB 00:00 2020-11-20T11:47:54.734 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T11:47:54.797 INFO:teuthology.orchestra.run.smithi036.stdout:(125/133): python3-scipy-1.0.0-20.module+el8.1. 19 MB/s | 15 MB 00:00 2020-11-20T11:47:54.798 INFO:teuthology.orchestra.run.smithi036.stdout:(126/133): socat-1.7.3.3-2.el8.x86_64.rpm 2.1 MB/s | 302 kB 00:00 2020-11-20T11:47:54.823 INFO:teuthology.orchestra.run.smithi036.stdout:(127/133): oniguruma-6.8.2-2.el8.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2020-11-20T11:47:54.864 INFO:teuthology.orchestra.run.smithi036.stdout:(128/133): NetworkManager-libnm-1.26.0-9.el8_3. 44 MB/s | 1.7 MB 00:00 2020-11-20T11:47:54.880 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T11:47:54.891 INFO:teuthology.orchestra.run.smithi036.stdout:(129/133): NetworkManager-tui-1.26.0-9.el8_3.x8 11 MB/s | 320 kB 00:00 2020-11-20T11:47:54.917 INFO:teuthology.orchestra.run.smithi036.stdout:(130/133): NetworkManager-team-1.26.0-9.el8_3.x 5.4 MB/s | 141 kB 00:00 2020-11-20T11:47:54.961 INFO:teuthology.orchestra.run.smithi036.stdout:(131/133): NetworkManager-1.26.0-9.el8_3.x86_64 56 MB/s | 2.4 MB 00:00 2020-11-20T11:47:55.076 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 4/139 2020-11-20T11:47:55.114 INFO:teuthology.orchestra.run.smithi036.stdout:(132/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 7.8 MB/s | 2.4 MB 00:00 2020-11-20T11:47:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T11:47:55.296 INFO:teuthology.orchestra.run.smithi036.stdout:(133/133): librados2-16.0.0-7397.gb86e691b.el8. 7.5 MB/s | 3.7 MB 00:00 2020-11-20T11:47:55.299 INFO:teuthology.orchestra.run.smithi036.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:47:55.300 INFO:teuthology.orchestra.run.smithi036.stdout:Total 14 MB/s | 199 MB 00:14 2020-11-20T11:47:55.366 INFO:teuthology.orchestra.run.smithi036.stdout:Running transaction check 2020-11-20T11:47:55.507 INFO:teuthology.orchestra.run.smithi036.stdout:Transaction check succeeded. 2020-11-20T11:47:55.508 INFO:teuthology.orchestra.run.smithi036.stdout:Running transaction test 2020-11-20T11:47:55.638 INFO:teuthology.orchestra.run.smithi164.stdout:(133/133): ceph-test-16.0.0-7397.gb86e691b.el8. 6.5 MB/s | 48 MB 00:07 2020-11-20T11:47:55.643 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:47:55.643 INFO:teuthology.orchestra.run.smithi164.stdout:Total 13 MB/s | 199 MB 00:15 2020-11-20T11:47:55.660 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T11:47:55.710 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2020-11-20T11:47:55.825 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:47:55.842 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2020-11-20T11:47:55.843 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2020-11-20T11:47:56.114 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:47:56.325 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:47:56.418 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:47:56.559 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:47:56.657 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:47:56.828 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:47:56.984 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T11:47:57.154 INFO:teuthology.orchestra.run.smithi036.stdout:Transaction test succeeded. 2020-11-20T11:47:57.158 INFO:teuthology.orchestra.run.smithi036.stdout:Running transaction 2020-11-20T11:47:57.378 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T11:47:57.513 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2020-11-20T11:47:57.517 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2020-11-20T11:47:57.525 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:47:57.642 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:47:57.854 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T11:47:58.027 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T11:47:58.158 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:47:58.554 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:47:58.766 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:47:58.817 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:47:59.108 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:47:59.325 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:47:59.650 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:47:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T11:47:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T11:48:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T11:48:00.536 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T11:48:00.646 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T11:48:01.502 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T11:48:01.649 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T11:48:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: Preparing : 1/1 2020-11-20T11:48:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T11:48:02.291 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T11:48:02.361 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T11:48:02.466 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T11:48:02.625 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/139 2020-11-20T11:48:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T11:48:02.797 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/139 2020-11-20T11:48:02.830 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 22/139 2020-11-20T11:48:02.889 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2020-11-20T11:48:02.944 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T11:48:02.970 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 23/139 2020-11-20T11:48:03.139 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/139 2020-11-20T11:48:03.157 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T11:48:03.228 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/139 2020-11-20T11:48:03.334 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T11:48:03.388 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/139 2020-11-20T11:48:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 5/139 2020-11-20T11:48:03.501 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T11:48:03.650 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/139 2020-11-20T11:48:03.721 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 5/139 2020-11-20T11:48:03.750 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 4/139 2020-11-20T11:48:03.882 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T11:48:03.905 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T11:48:03.922 INFO:teuthology.orchestra.run.smithi036.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:48:04.036 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:48:04.053 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T11:48:04.203 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T11:48:04.222 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:48:04.290 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T11:48:04.324 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:48:04.496 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:48:04.507 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:48:04.655 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/139 2020-11-20T11:48:04.711 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/139 2020-11-20T11:48:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:48:05.101 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T11:48:05.215 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 10/139 2020-11-20T11:48:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:48:05.396 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 31/139 2020-11-20T11:48:05.434 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:48:05.555 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:48:05.613 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 32/139 2020-11-20T11:48:05.635 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T11:48:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:48:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T11:48:05.828 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/139 2020-11-20T11:48:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:48:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:48:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:48:06.049 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 34/139 2020-11-20T11:48:06.161 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:48:06.257 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T11:48:06.333 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:48:06.363 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T11:48:06.571 INFO:teuthology.orchestra.run.smithi036.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:48:06.640 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:48:06.778 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T11:48:06.929 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:48:06.935 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:48:07.039 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:48:07.164 INFO:teuthology.orchestra.run.smithi036.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:48:07.275 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T11:48:07.473 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T11:48:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:48:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:48:07.654 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/139 2020-11-20T11:48:07.925 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/139 2020-11-20T11:48:08.001 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:48:08.237 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:48:08.316 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:48:08.429 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/139 2020-11-20T11:48:08.531 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T11:48:08.612 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:48:08.697 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 20/139 2020-11-20T11:48:08.816 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 20/139 2020-11-20T11:48:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 36/139 2020-11-20T11:48:08.879 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:48:08.938 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 21/139 2020-11-20T11:48:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T11:48:09.201 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T11:48:09.226 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:48:09.354 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T11:48:09.389 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T11:48:09.484 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 21/139 2020-11-20T11:48:09.515 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T11:48:09.570 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T11:48:09.621 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 22/139 2020-11-20T11:48:09.664 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T11:48:09.743 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T11:48:09.916 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/139 2020-11-20T11:48:10.160 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T11:48:10.168 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 22/139 2020-11-20T11:48:10.249 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 43/139 2020-11-20T11:48:10.302 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T11:48:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : openblas-0.3.3-5.el8.x86_64 23/139 2020-11-20T11:48:10.436 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 44/139 2020-11-20T11:48:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 45/139 2020-11-20T11:48:10.746 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 46/139 2020-11-20T11:48:10.792 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T11:48:10.970 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T11:48:10.996 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 47/139 2020-11-20T11:48:11.097 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 23/139 2020-11-20T11:48:11.160 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 48/139 2020-11-20T11:48:11.160 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 49/139 2020-11-20T11:48:11.161 INFO:teuthology.orchestra.run.smithi188.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:48:11.161 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:48:11.332 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 24/139 2020-11-20T11:48:11.510 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.7-12.el8.x86_64 50/139 2020-11-20T11:48:11.528 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 25/139 2020-11-20T11:48:11.671 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 51/139 2020-11-20T11:48:11.685 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T11:48:11.713 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 26/139 2020-11-20T11:48:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 52/139 2020-11-20T11:48:11.950 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T11:48:11.956 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/139 2020-11-20T11:48:12.101 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T11:48:12.193 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 22/139 2020-11-20T11:48:12.216 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 53/139 2020-11-20T11:48:12.236 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T11:48:12.350 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 23/139 2020-11-20T11:48:12.390 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T11:48:12.488 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 54/139 2020-11-20T11:48:12.569 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/139 2020-11-20T11:48:12.632 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 31/139 2020-11-20T11:48:12.804 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 32/139 2020-11-20T11:48:12.819 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/139 2020-11-20T11:48:12.846 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 55/139 2020-11-20T11:48:13.059 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 56/139 2020-11-20T11:48:13.104 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/139 2020-11-20T11:48:13.249 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 57/139 2020-11-20T11:48:13.369 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T11:48:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 58/139 2020-11-20T11:48:13.550 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T11:48:13.703 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T11:48:13.727 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 59/139 2020-11-20T11:48:13.888 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 60/139 2020-11-20T11:48:14.090 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/139 2020-11-20T11:48:14.296 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 62/139 2020-11-20T11:48:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 63/139 2020-11-20T11:48:14.603 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T11:48:14.696 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T11:48:14.775 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T11:48:14.932 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 31/139 2020-11-20T11:48:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 32/139 2020-11-20T11:48:14.985 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : jq-1.5-12.el8.x86_64 65/139 2020-11-20T11:48:15.154 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 66/139 2020-11-20T11:48:15.168 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 32/139 2020-11-20T11:48:15.336 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/139 2020-11-20T11:48:15.399 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/139 2020-11-20T11:48:15.495 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 68/139 2020-11-20T11:48:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 34/139 2020-11-20T11:48:15.734 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 69/139 2020-11-20T11:48:15.853 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T11:48:15.963 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 70/139 2020-11-20T11:48:16.008 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 33/139 2020-11-20T11:48:16.275 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 71/139 2020-11-20T11:48:16.318 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/139 2020-11-20T11:48:16.462 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : automake-1.16.1-6.el8.noarch 72/139 2020-11-20T11:48:16.531 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/139 2020-11-20T11:48:16.626 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T11:48:16.759 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 36/139 2020-11-20T11:48:16.889 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T11:48:16.945 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T11:48:17.091 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T11:48:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T11:48:17.225 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T11:48:17.313 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T11:48:17.372 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T11:48:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T11:48:17.571 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T11:48:17.641 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T11:48:17.770 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 42/139 2020-11-20T11:48:17.790 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T11:48:17.837 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 42/139 2020-11-20T11:48:17.894 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T11:48:17.957 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T11:48:18.019 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : jq-1.5-12.el8.x86_64 43/139 2020-11-20T11:48:18.123 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T11:48:18.162 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/139 2020-11-20T11:48:18.177 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 36/139 2020-11-20T11:48:18.328 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 45/139 2020-11-20T11:48:18.338 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T11:48:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T11:48:18.462 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 46/139 2020-11-20T11:48:18.516 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T11:48:18.606 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T11:48:18.626 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 47/139 2020-11-20T11:48:18.709 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T11:48:18.785 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T11:48:19.137 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T11:48:19.137 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 48/139 2020-11-20T11:48:19.138 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T11:48:19.138 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 49/139 2020-11-20T11:48:19.148 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T11:48:19.181 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T11:48:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : automake-1.16.1-6.el8.noarch 50/139 2020-11-20T11:48:19.363 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/139 2020-11-20T11:48:19.505 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T11:48:19.566 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 51/139 2020-11-20T11:48:19.666 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 43/139 2020-11-20T11:48:19.757 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T11:48:19.841 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 44/139 2020-11-20T11:48:19.887 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 52/139 2020-11-20T11:48:19.962 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T11:48:20.010 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 45/139 2020-11-20T11:48:20.076 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 53/139 2020-11-20T11:48:20.186 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 46/139 2020-11-20T11:48:20.228 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 54/139 2020-11-20T11:48:20.277 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T11:48:20.380 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 55/139 2020-11-20T11:48:20.426 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 47/139 2020-11-20T11:48:20.510 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T11:48:20.597 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 48/139 2020-11-20T11:48:20.598 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 49/139 2020-11-20T11:48:20.598 INFO:teuthology.orchestra.run.smithi164.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:48:20.598 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:48:20.660 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 56/139 2020-11-20T11:48:20.668 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T11:48:20.842 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T11:48:20.847 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 57/139 2020-11-20T11:48:20.848 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 58/139 2020-11-20T11:48:20.848 INFO:teuthology.orchestra.run.smithi036.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:48:20.848 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:48:20.990 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.7-12.el8.x86_64 50/139 2020-11-20T11:48:21.168 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 51/139 2020-11-20T11:48:21.202 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : fuse-2.9.7-12.el8.x86_64 59/139 2020-11-20T11:48:21.356 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/139 2020-11-20T11:48:21.430 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 52/139 2020-11-20T11:48:21.682 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 61/139 2020-11-20T11:48:21.693 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 53/139 2020-11-20T11:48:21.865 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 62/139 2020-11-20T11:48:21.926 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T11:48:22.003 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 54/139 2020-11-20T11:48:22.097 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 63/139 2020-11-20T11:48:22.160 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T11:48:22.359 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 55/139 2020-11-20T11:48:22.408 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T11:48:22.425 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 64/139 2020-11-20T11:48:22.572 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 56/139 2020-11-20T11:48:22.607 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T11:48:22.716 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 65/139 2020-11-20T11:48:22.792 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 57/139 2020-11-20T11:48:22.796 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T11:48:22.917 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 66/139 2020-11-20T11:48:22.955 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T11:48:23.077 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 58/139 2020-11-20T11:48:23.111 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T11:48:23.134 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 67/139 2020-11-20T11:48:23.265 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 59/139 2020-11-20T11:48:23.327 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 68/139 2020-11-20T11:48:23.443 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 60/139 2020-11-20T11:48:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 69/139 2020-11-20T11:48:23.612 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/139 2020-11-20T11:48:23.672 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/139 2020-11-20T11:48:23.836 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 62/139 2020-11-20T11:48:23.884 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 71/139 2020-11-20T11:48:24.072 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 63/139 2020-11-20T11:48:24.129 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 72/139 2020-11-20T11:48:24.268 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T11:48:24.283 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T11:48:24.336 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T11:48:24.515 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jq-1.5-12.el8.x86_64 65/139 2020-11-20T11:48:24.533 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T11:48:24.677 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 66/139 2020-11-20T11:48:24.710 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T11:48:24.851 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/139 2020-11-20T11:48:24.858 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T11:48:25.006 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T11:48:25.010 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 68/139 2020-11-20T11:48:25.181 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T11:48:25.199 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 69/139 2020-11-20T11:48:25.366 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T11:48:25.463 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 70/139 2020-11-20T11:48:25.506 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T11:48:25.642 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T11:48:25.784 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 71/139 2020-11-20T11:48:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T11:48:25.985 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.1-6.el8.noarch 72/139 2020-11-20T11:48:26.016 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T11:48:26.178 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T11:48:26.210 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T11:48:26.423 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T11:48:26.458 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T11:48:26.642 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T11:48:26.682 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T11:48:26.823 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T11:48:26.980 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T11:48:27.014 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T11:48:27.098 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:48:27.215 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T11:48:27.254 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T11:48:27.409 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T11:48:27.438 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T11:48:27.584 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T11:48:27.591 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:48:27.717 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T11:48:27.719 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T11:48:27.918 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T11:48:27.960 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T11:48:28.077 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T11:48:28.139 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T11:48:28.287 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T11:48:28.311 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:48:28.374 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T11:48:28.575 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:48:28.632 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T11:48:28.667 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:48:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:48:28.888 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T11:48:29.249 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T11:48:29.435 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T11:48:29.958 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T11:48:29.958 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T11:48:29.959 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T11:48:29.960 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T11:48:30.034 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T11:48:30.036 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T11:48:30.230 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T11:48:30.267 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T11:48:30.424 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T11:48:30.448 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T11:48:30.619 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T11:48:30.651 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T11:48:31.773 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T11:48:32.000 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T11:48:32.256 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T11:48:32.464 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T11:48:32.687 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T11:48:32.886 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T11:48:33.042 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T11:48:34.896 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:48:35.202 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:48:35.957 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:48:36.229 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:48:36.326 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:48:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:48:37.141 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:48:37.375 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:48:38.105 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:48:38.357 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:48:38.470 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:48:38.591 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:48:45.827 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:48:45.827 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2020-11-20T11:48:45.828 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2020-11-20T11:48:45.828 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /dev 2020-11-20T11:48:45.828 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /run 2020-11-20T11:48:45.828 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2020-11-20T11:48:45.828 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2020-11-20T11:48:45.829 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2020-11-20T11:48:45.829 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2020-11-20T11:48:45.829 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /dev 2020-11-20T11:48:45.829 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:48:46.165 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:48:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:48:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:48:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:48:48.470 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:48:48.497 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:48:50.605 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:48:50.805 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:48:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T11:48:51.074 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T11:48:51.204 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:48:52.096 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:48:52.336 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:48:53.379 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:48:53.537 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:48:53.623 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:48:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T11:48:54.161 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:48:54.191 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:48:54.229 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:48:54.229 INFO:teuthology.orchestra.run.smithi036.stdout:skipping the directory /sys 2020-11-20T11:48:54.230 INFO:teuthology.orchestra.run.smithi036.stdout:skipping the directory /proc 2020-11-20T11:48:54.230 INFO:teuthology.orchestra.run.smithi036.stdout:skipping the directory /dev 2020-11-20T11:48:54.230 INFO:teuthology.orchestra.run.smithi036.stdout:skipping the directory /run 2020-11-20T11:48:54.230 INFO:teuthology.orchestra.run.smithi036.stdout:skipping the directory /mnt 2020-11-20T11:48:54.230 INFO:teuthology.orchestra.run.smithi036.stdout:skipping the directory /var/tmp 2020-11-20T11:48:54.231 INFO:teuthology.orchestra.run.smithi036.stdout:skipping the directory /home 2020-11-20T11:48:54.231 INFO:teuthology.orchestra.run.smithi036.stdout:skipping the directory /tmp 2020-11-20T11:48:54.231 INFO:teuthology.orchestra.run.smithi036.stdout:skipping the directory /dev 2020-11-20T11:48:54.231 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:48:54.354 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:48:54.370 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:48:54.574 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:48:55.034 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:48:55.176 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:48:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T11:48:55.857 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:48:55.857 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2020-11-20T11:48:55.858 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2020-11-20T11:48:55.858 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /dev 2020-11-20T11:48:55.859 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /run 2020-11-20T11:48:55.859 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2020-11-20T11:48:55.859 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2020-11-20T11:48:55.860 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2020-11-20T11:48:55.860 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2020-11-20T11:48:55.860 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /dev 2020-11-20T11:48:55.862 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:48:56.217 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:48:56.652 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:48:56.662 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:48:56.786 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:48:56.789 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:48:57.041 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:48:57.143 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:48:57.169 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:48:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:48:58.300 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:48:58.537 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:48:58.570 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:48:59.320 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:48:59.502 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:48:59.614 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T11:48:59.789 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T11:48:59.923 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:49:00.612 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:49:00.816 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:49:00.872 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:49:00.936 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T11:49:01.118 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T11:49:01.150 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:49:01.254 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:49:01.612 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:49:01.935 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T11:49:02.086 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T11:49:02.147 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:49:02.260 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:49:02.378 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:49:02.474 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:49:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:49:02.792 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T11:49:02.885 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T11:49:03.059 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:49:03.080 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 121/139 2020-11-20T11:49:03.089 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:49:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 122/139 2020-11-20T11:49:03.239 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:49:03.254 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:49:03.420 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 123/139 2020-11-20T11:49:03.423 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:49:03.565 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T11:49:03.612 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:49:03.699 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:49:03.742 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T11:49:03.946 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T11:49:04.038 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T11:49:04.102 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T11:49:04.268 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:49:04.454 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T11:49:04.468 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T11:49:04.619 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:49:04.631 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:49:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:49:04.650 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:49:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:49:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:49:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:49:04.885 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/139 2020-11-20T11:49:05.027 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:49:05.068 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T11:49:05.128 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T11:49:05.206 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:49:05.309 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T11:49:05.328 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T11:49:05.452 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T11:49:05.453 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:49:05.669 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:49:05.812 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T11:49:05.826 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:05.826 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T11:49:06.170 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:49:06.247 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:06.248 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:49:06.437 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:49:06.437 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:49:06.564 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:49:06.720 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:49:07.234 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:49:07.234 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T11:49:07.234 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T11:49:07.235 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T11:49:07.235 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T11:49:07.235 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T11:49:07.235 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:49:07.235 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:49:07.236 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:49:07.236 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:49:07.236 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T11:49:07.236 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:49:07.236 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T11:49:07.237 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T11:49:07.237 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T11:49:07.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T11:49:07.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T11:49:07.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T11:49:07.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T11:49:07.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T11:49:07.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T11:49:07.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T11:49:07.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T11:49:07.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T11:49:07.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T11:49:07.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T11:49:07.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T11:49:07.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T11:49:07.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T11:49:07.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T11:49:07.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T11:49:07.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T11:49:07.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T11:49:07.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T11:49:07.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T11:49:07.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T11:49:07.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T11:49:07.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T11:49:07.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T11:49:07.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T11:49:07.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T11:49:07.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T11:49:07.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T11:49:07.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T11:49:07.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T11:49:07.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T11:49:07.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T11:49:07.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T11:49:07.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T11:49:07.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T11:49:07.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T11:49:07.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T11:49:07.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T11:49:07.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T11:49:07.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T11:49:07.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T11:49:07.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T11:49:07.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T11:49:07.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T11:49:07.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T11:49:07.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T11:49:07.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T11:49:07.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T11:49:07.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T11:49:07.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T11:49:07.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T11:49:07.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T11:49:07.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T11:49:07.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T11:49:07.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T11:49:07.259 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T11:49:07.259 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : automake-1.16.1-6.el8.noarch 71/139 2020-11-20T11:49:07.259 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 72/139 2020-11-20T11:49:07.259 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 73/139 2020-11-20T11:49:07.259 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : jq-1.5-12.el8.x86_64 74/139 2020-11-20T11:49:07.260 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 75/139 2020-11-20T11:49:07.260 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 76/139 2020-11-20T11:49:07.260 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 77/139 2020-11-20T11:49:07.260 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 78/139 2020-11-20T11:49:07.260 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 79/139 2020-11-20T11:49:07.261 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 80/139 2020-11-20T11:49:07.261 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 81/139 2020-11-20T11:49:07.261 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 82/139 2020-11-20T11:49:07.261 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 83/139 2020-11-20T11:49:07.261 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/139 2020-11-20T11:49:07.262 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 85/139 2020-11-20T11:49:07.262 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/139 2020-11-20T11:49:07.262 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 87/139 2020-11-20T11:49:07.262 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : bison-3.0.4-10.el8.x86_64 88/139 2020-11-20T11:49:07.262 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 89/139 2020-11-20T11:49:07.263 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 90/139 2020-11-20T11:49:07.263 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 91/139 2020-11-20T11:49:07.263 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 92/139 2020-11-20T11:49:07.263 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 93/139 2020-11-20T11:49:07.263 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 94/139 2020-11-20T11:49:07.264 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 95/139 2020-11-20T11:49:07.264 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 96/139 2020-11-20T11:49:07.264 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 97/139 2020-11-20T11:49:07.264 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 98/139 2020-11-20T11:49:07.264 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/139 2020-11-20T11:49:07.264 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 100/139 2020-11-20T11:49:07.265 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 101/139 2020-11-20T11:49:07.265 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 102/139 2020-11-20T11:49:07.265 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/139 2020-11-20T11:49:07.265 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 104/139 2020-11-20T11:49:07.265 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 105/139 2020-11-20T11:49:07.266 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 106/139 2020-11-20T11:49:07.266 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 107/139 2020-11-20T11:49:07.266 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 108/139 2020-11-20T11:49:07.266 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 109/139 2020-11-20T11:49:07.266 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 110/139 2020-11-20T11:49:07.267 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 111/139 2020-11-20T11:49:07.267 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 112/139 2020-11-20T11:49:07.267 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 113/139 2020-11-20T11:49:07.267 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 114/139 2020-11-20T11:49:07.267 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 115/139 2020-11-20T11:49:07.268 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 116/139 2020-11-20T11:49:07.268 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 117/139 2020-11-20T11:49:07.268 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 118/139 2020-11-20T11:49:07.268 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 119/139 2020-11-20T11:49:07.268 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 120/139 2020-11-20T11:49:07.269 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 121/139 2020-11-20T11:49:07.269 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 122/139 2020-11-20T11:49:07.269 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 123/139 2020-11-20T11:49:07.269 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 124/139 2020-11-20T11:49:07.269 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 125/139 2020-11-20T11:49:07.270 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 126/139 2020-11-20T11:49:07.270 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 127/139 2020-11-20T11:49:07.270 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:49:07.270 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T11:49:07.270 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T11:49:07.271 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T11:49:07.271 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T11:49:07.271 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T11:49:07.271 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T11:49:07.271 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T11:49:07.271 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T11:49:07.272 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:07.272 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T11:49:09.226 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T11:49:09.226 INFO:teuthology.orchestra.run.smithi188.stdout:Installed products updated. 2020-11-20T11:49:09.861 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:49:10.820 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T11:49:11.102 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:49:11.103 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 120/139 2020-11-20T11:49:11.251 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 121/139 2020-11-20T11:49:11.410 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T11:49:11.480 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 122/139 2020-11-20T11:49:11.586 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T11:49:11.645 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/139 2020-11-20T11:49:11.659 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/139 2020-11-20T11:49:11.680 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:11.681 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2020-11-20T11:49:11.681 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:11.681 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:11.681 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:11.682 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:11.682 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.682 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.682 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:11.683 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2020-11-20T11:49:11.683 INFO:teuthology.orchestra.run.smithi188.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:49:11.683 INFO:teuthology.orchestra.run.smithi188.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:49:11.684 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.684 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.684 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.684 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.685 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:11.685 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.685 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.685 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.686 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:11.686 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:11.686 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:11.686 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:11.687 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:11.687 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.687 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.687 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:11.687 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.688 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.688 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.688 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:11.688 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T11:49:11.689 INFO:teuthology.orchestra.run.smithi188.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:49:11.689 INFO:teuthology.orchestra.run.smithi188.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:49:11.689 INFO:teuthology.orchestra.run.smithi188.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:49:11.690 INFO:teuthology.orchestra.run.smithi188.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:49:11.690 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:49:11.690 INFO:teuthology.orchestra.run.smithi188.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:49:11.690 INFO:teuthology.orchestra.run.smithi188.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:49:11.690 INFO:teuthology.orchestra.run.smithi188.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T11:49:11.691 INFO:teuthology.orchestra.run.smithi188.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:49:11.691 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:49:11.691 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.691 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.691 INFO:teuthology.orchestra.run.smithi188.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T11:49:11.692 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T11:49:11.692 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:49:11.692 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T11:49:11.692 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T11:49:11.693 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.693 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.693 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:49:11.693 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.694 INFO:teuthology.orchestra.run.smithi188.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T11:49:11.694 INFO:teuthology.orchestra.run.smithi188.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:49:11.694 INFO:teuthology.orchestra.run.smithi188.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:49:11.694 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:49:11.694 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T11:49:11.695 INFO:teuthology.orchestra.run.smithi188.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:49:11.695 INFO:teuthology.orchestra.run.smithi188.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T11:49:11.695 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:49:11.695 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T11:49:11.695 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T11:49:11.696 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T11:49:11.696 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T11:49:11.696 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T11:49:11.696 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T11:49:11.696 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T11:49:11.697 INFO:teuthology.orchestra.run.smithi188.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:49:11.697 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T11:49:11.697 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:49:11.697 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:49:11.698 INFO:teuthology.orchestra.run.smithi188.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:49:11.698 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:49:11.698 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.698 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.698 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.699 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:49:11.699 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T11:49:11.699 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:49:11.700 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:49:11.700 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T11:49:11.701 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:49:11.701 INFO:teuthology.orchestra.run.smithi188.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:49:11.701 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:49:11.701 INFO:teuthology.orchestra.run.smithi188.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:49:11.701 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:49:11.702 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:49:11.702 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:49:11.702 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:49:11.702 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:49:11.702 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:49:11.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:49:11.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:49:11.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:49:11.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:49:11.703 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:49:11.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:49:11.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:49:11.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:49:11.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:49:11.704 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:49:11.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:49:11.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:49:11.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T11:49:11.705 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:49:11.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:49:11.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T11:49:11.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:49:11.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.706 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:49:11.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:49:11.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:49:11.707 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:49:11.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:49:11.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T11:49:11.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:49:11.709 INFO:teuthology.orchestra.run.smithi188.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:49:11.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:49:11.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:49:11.710 INFO:teuthology.orchestra.run.smithi188.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:49:11.711 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:49:11.711 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:49:11.712 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:49:11.712 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:49:11.712 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:49:11.713 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:49:11.713 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.713 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.714 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:11.714 INFO:teuthology.orchestra.run.smithi188.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T11:49:11.715 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T11:49:11.715 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:49:11.715 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T11:49:11.716 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:11.717 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2020-11-20T11:49:11.801 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T11:49:11.912 DEBUG:teuthology.parallel:result is None 2020-11-20T11:49:11.953 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T11:49:12.099 INFO:teuthology.orchestra.run.smithi036.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T11:49:12.255 INFO:teuthology.orchestra.run.smithi036.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T11:49:12.308 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T11:49:12.431 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:49:12.581 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 121/139 2020-11-20T11:49:12.626 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T11:49:12.750 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 122/139 2020-11-20T11:49:12.830 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:49:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:49:12.960 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 123/139 2020-11-20T11:49:13.096 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T11:49:13.113 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/139 2020-11-20T11:49:13.169 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/139 2020-11-20T11:49:13.272 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T11:49:13.312 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/139 2020-11-20T11:49:13.325 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/139 2020-11-20T11:49:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 133/139 2020-11-20T11:49:13.465 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T11:49:13.531 INFO:teuthology.orchestra.run.smithi036.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T11:49:13.531 INFO:teuthology.orchestra.run.smithi036.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:49:13.635 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T11:49:13.732 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:49:13.839 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:49:13.873 INFO:teuthology.orchestra.run.smithi036.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T11:49:13.887 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:13.888 INFO:teuthology.orchestra.run.smithi036.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:14.004 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T11:49:14.215 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:49:14.240 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:49:14.334 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:14.334 INFO:teuthology.orchestra.run.smithi036.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:49:14.469 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/139 2020-11-20T11:49:14.525 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:49:14.526 INFO:teuthology.orchestra.run.smithi036.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:49:14.633 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T11:49:14.694 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T11:49:14.893 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T11:49:14.916 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T11:49:15.028 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T11:49:15.029 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:49:15.254 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:49:15.284 INFO:teuthology.orchestra.run.smithi036.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:49:15.285 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T11:49:15.285 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T11:49:15.285 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T11:49:15.286 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T11:49:15.286 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T11:49:15.286 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:49:15.286 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:49:15.286 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:49:15.287 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:49:15.287 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T11:49:15.287 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:49:15.287 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T11:49:15.288 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T11:49:15.288 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T11:49:15.288 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T11:49:15.288 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T11:49:15.288 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T11:49:15.289 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T11:49:15.289 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T11:49:15.290 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T11:49:15.290 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T11:49:15.290 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T11:49:15.290 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T11:49:15.290 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T11:49:15.291 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T11:49:15.291 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T11:49:15.291 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T11:49:15.291 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T11:49:15.300 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T11:49:15.300 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T11:49:15.300 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T11:49:15.300 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T11:49:15.301 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T11:49:15.301 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T11:49:15.301 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T11:49:15.301 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T11:49:15.301 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T11:49:15.302 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T11:49:15.302 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T11:49:15.302 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T11:49:15.302 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T11:49:15.302 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T11:49:15.303 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T11:49:15.303 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T11:49:15.303 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T11:49:15.303 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T11:49:15.303 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T11:49:15.304 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T11:49:15.304 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T11:49:15.304 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T11:49:15.304 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T11:49:15.304 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T11:49:15.305 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T11:49:15.305 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T11:49:15.305 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T11:49:15.305 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T11:49:15.305 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T11:49:15.306 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T11:49:15.306 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T11:49:15.306 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T11:49:15.306 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T11:49:15.306 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T11:49:15.307 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T11:49:15.307 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T11:49:15.307 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T11:49:15.307 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T11:49:15.307 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T11:49:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T11:49:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T11:49:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T11:49:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 71/139 2020-11-20T11:49:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/139 2020-11-20T11:49:15.309 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 73/139 2020-11-20T11:49:15.309 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/139 2020-11-20T11:49:15.309 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 75/139 2020-11-20T11:49:15.309 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/139 2020-11-20T11:49:15.309 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 77/139 2020-11-20T11:49:15.310 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 78/139 2020-11-20T11:49:15.310 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 79/139 2020-11-20T11:49:15.310 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 80/139 2020-11-20T11:49:15.310 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 81/139 2020-11-20T11:49:15.310 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/139 2020-11-20T11:49:15.311 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 83/139 2020-11-20T11:49:15.311 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 84/139 2020-11-20T11:49:15.311 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 85/139 2020-11-20T11:49:15.311 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 86/139 2020-11-20T11:49:15.311 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 87/139 2020-11-20T11:49:15.312 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 88/139 2020-11-20T11:49:15.312 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 89/139 2020-11-20T11:49:15.312 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 90/139 2020-11-20T11:49:15.312 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 91/139 2020-11-20T11:49:15.312 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 92/139 2020-11-20T11:49:15.313 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 93/139 2020-11-20T11:49:15.313 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 94/139 2020-11-20T11:49:15.313 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 95/139 2020-11-20T11:49:15.313 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 96/139 2020-11-20T11:49:15.313 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 97/139 2020-11-20T11:49:15.314 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 98/139 2020-11-20T11:49:15.314 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : automake-1.16.1-6.el8.noarch 99/139 2020-11-20T11:49:15.314 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 100/139 2020-11-20T11:49:15.314 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 101/139 2020-11-20T11:49:15.314 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : jq-1.5-12.el8.x86_64 102/139 2020-11-20T11:49:15.315 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 103/139 2020-11-20T11:49:15.315 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/139 2020-11-20T11:49:15.315 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 105/139 2020-11-20T11:49:15.315 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 106/139 2020-11-20T11:49:15.315 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 107/139 2020-11-20T11:49:15.316 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 108/139 2020-11-20T11:49:15.316 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 109/139 2020-11-20T11:49:15.316 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 110/139 2020-11-20T11:49:15.316 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/139 2020-11-20T11:49:15.316 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/139 2020-11-20T11:49:15.317 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 113/139 2020-11-20T11:49:15.317 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : flex-2.6.1-9.el8.x86_64 114/139 2020-11-20T11:49:15.317 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 115/139 2020-11-20T11:49:15.317 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : bison-3.0.4-10.el8.x86_64 116/139 2020-11-20T11:49:15.317 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 117/139 2020-11-20T11:49:15.318 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 118/139 2020-11-20T11:49:15.318 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 119/139 2020-11-20T11:49:15.318 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 120/139 2020-11-20T11:49:15.318 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 121/139 2020-11-20T11:49:15.318 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 122/139 2020-11-20T11:49:15.319 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 123/139 2020-11-20T11:49:15.319 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 124/139 2020-11-20T11:49:15.319 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 125/139 2020-11-20T11:49:15.319 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 126/139 2020-11-20T11:49:15.319 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 127/139 2020-11-20T11:49:15.320 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:49:15.320 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T11:49:15.320 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T11:49:15.320 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T11:49:15.320 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T11:49:15.321 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T11:49:15.321 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T11:49:15.321 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T11:49:15.321 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T11:49:15.321 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:15.322 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T11:49:15.374 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T11:49:15.389 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:15.389 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:15.831 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:15.831 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:49:16.055 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:49:16.055 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:49:16.856 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:49:16.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T11:49:16.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T11:49:16.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T11:49:16.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T11:49:16.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T11:49:16.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:49:16.858 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:49:16.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:49:16.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:49:16.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T11:49:16.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:49:16.859 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T11:49:16.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T11:49:16.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T11:49:16.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T11:49:16.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T11:49:16.860 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T11:49:16.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T11:49:16.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T11:49:16.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T11:49:16.861 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T11:49:16.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T11:49:16.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T11:49:16.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T11:49:16.862 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T11:49:16.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T11:49:16.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T11:49:16.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T11:49:16.863 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T11:49:16.872 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T11:49:16.873 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T11:49:16.873 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T11:49:16.873 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T11:49:16.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T11:49:16.874 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T11:49:16.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T11:49:16.875 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T11:49:16.876 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T11:49:16.876 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T11:49:16.876 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T11:49:16.876 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T11:49:16.877 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T11:49:16.877 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T11:49:16.878 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T11:49:16.878 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T11:49:16.878 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T11:49:16.879 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T11:49:16.879 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T11:49:16.879 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T11:49:16.880 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T11:49:16.880 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T11:49:16.880 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T11:49:16.881 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T11:49:16.881 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T11:49:16.881 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T11:49:16.882 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T11:49:16.882 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T11:49:16.882 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T11:49:16.883 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T11:49:16.883 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T11:49:16.883 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T11:49:16.884 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T11:49:16.884 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T11:49:16.885 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T11:49:16.885 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T11:49:16.885 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T11:49:16.885 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T11:49:16.886 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T11:49:16.886 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T11:49:16.886 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T11:49:16.886 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.1-6.el8.noarch 71/139 2020-11-20T11:49:16.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 72/139 2020-11-20T11:49:16.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 73/139 2020-11-20T11:49:16.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jq-1.5-12.el8.x86_64 74/139 2020-11-20T11:49:16.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 75/139 2020-11-20T11:49:16.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 76/139 2020-11-20T11:49:16.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 77/139 2020-11-20T11:49:16.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 78/139 2020-11-20T11:49:16.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 79/139 2020-11-20T11:49:16.888 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 80/139 2020-11-20T11:49:16.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 81/139 2020-11-20T11:49:16.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 82/139 2020-11-20T11:49:16.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 83/139 2020-11-20T11:49:16.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/139 2020-11-20T11:49:16.889 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 85/139 2020-11-20T11:49:16.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/139 2020-11-20T11:49:16.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 87/139 2020-11-20T11:49:16.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.0.4-10.el8.x86_64 88/139 2020-11-20T11:49:16.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 89/139 2020-11-20T11:49:16.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 90/139 2020-11-20T11:49:16.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 91/139 2020-11-20T11:49:16.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 92/139 2020-11-20T11:49:16.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 93/139 2020-11-20T11:49:16.891 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 94/139 2020-11-20T11:49:16.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 95/139 2020-11-20T11:49:16.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 96/139 2020-11-20T11:49:16.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 97/139 2020-11-20T11:49:16.892 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 98/139 2020-11-20T11:49:16.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/139 2020-11-20T11:49:16.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 100/139 2020-11-20T11:49:16.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 101/139 2020-11-20T11:49:16.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 102/139 2020-11-20T11:49:16.893 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/139 2020-11-20T11:49:16.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 104/139 2020-11-20T11:49:16.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 105/139 2020-11-20T11:49:16.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 106/139 2020-11-20T11:49:16.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 107/139 2020-11-20T11:49:16.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 108/139 2020-11-20T11:49:16.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 109/139 2020-11-20T11:49:16.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 110/139 2020-11-20T11:49:16.895 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 111/139 2020-11-20T11:49:16.896 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 112/139 2020-11-20T11:49:16.896 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 113/139 2020-11-20T11:49:16.896 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 114/139 2020-11-20T11:49:16.896 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 115/139 2020-11-20T11:49:16.896 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 116/139 2020-11-20T11:49:16.897 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 117/139 2020-11-20T11:49:16.897 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 118/139 2020-11-20T11:49:16.897 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 119/139 2020-11-20T11:49:16.898 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 120/139 2020-11-20T11:49:16.898 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 121/139 2020-11-20T11:49:16.898 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 122/139 2020-11-20T11:49:16.898 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 123/139 2020-11-20T11:49:16.898 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 124/139 2020-11-20T11:49:16.899 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 125/139 2020-11-20T11:49:16.899 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 126/139 2020-11-20T11:49:16.899 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 127/139 2020-11-20T11:49:16.900 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:49:16.900 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T11:49:16.900 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T11:49:16.900 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T11:49:16.900 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T11:49:16.901 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T11:49:16.901 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T11:49:16.901 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T11:49:16.901 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T11:49:16.902 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:49:16.902 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T11:49:17.206 INFO:teuthology.orchestra.run.smithi036.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T11:49:17.325 INFO:teuthology.orchestra.run.smithi036.stdout:Installed products updated. 2020-11-20T11:49:18.873 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T11:49:18.873 INFO:teuthology.orchestra.run.smithi164.stdout:Installed products updated. 2020-11-20T11:49:19.749 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:19.749 INFO:teuthology.orchestra.run.smithi036.stdout:Upgraded: 2020-11-20T11:49:19.749 INFO:teuthology.orchestra.run.smithi036.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:19.749 INFO:teuthology.orchestra.run.smithi036.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:19.750 INFO:teuthology.orchestra.run.smithi036.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:19.750 INFO:teuthology.orchestra.run.smithi036.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:19.750 INFO:teuthology.orchestra.run.smithi036.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.750 INFO:teuthology.orchestra.run.smithi036.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.750 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:19.751 INFO:teuthology.orchestra.run.smithi036.stdout:Installed: 2020-11-20T11:49:19.751 INFO:teuthology.orchestra.run.smithi036.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:49:19.751 INFO:teuthology.orchestra.run.smithi036.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:49:19.751 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.751 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.752 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.752 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.752 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:19.752 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.753 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.753 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.753 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:19.753 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:19.754 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:19.754 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:19.754 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:19.754 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.754 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.755 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:19.755 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.755 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.755 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.755 INFO:teuthology.orchestra.run.smithi036.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:19.756 INFO:teuthology.orchestra.run.smithi036.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T11:49:19.756 INFO:teuthology.orchestra.run.smithi036.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:49:19.756 INFO:teuthology.orchestra.run.smithi036.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:49:19.756 INFO:teuthology.orchestra.run.smithi036.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:49:19.756 INFO:teuthology.orchestra.run.smithi036.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:49:19.757 INFO:teuthology.orchestra.run.smithi036.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:49:19.757 INFO:teuthology.orchestra.run.smithi036.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:49:19.757 INFO:teuthology.orchestra.run.smithi036.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:49:19.757 INFO:teuthology.orchestra.run.smithi036.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T11:49:19.757 INFO:teuthology.orchestra.run.smithi036.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:49:19.758 INFO:teuthology.orchestra.run.smithi036.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:49:19.758 INFO:teuthology.orchestra.run.smithi036.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.758 INFO:teuthology.orchestra.run.smithi036.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.759 INFO:teuthology.orchestra.run.smithi036.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T11:49:19.759 INFO:teuthology.orchestra.run.smithi036.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T11:49:19.759 INFO:teuthology.orchestra.run.smithi036.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:49:19.759 INFO:teuthology.orchestra.run.smithi036.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T11:49:19.759 INFO:teuthology.orchestra.run.smithi036.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T11:49:19.760 INFO:teuthology.orchestra.run.smithi036.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.760 INFO:teuthology.orchestra.run.smithi036.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.760 INFO:teuthology.orchestra.run.smithi036.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:49:19.760 INFO:teuthology.orchestra.run.smithi036.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.760 INFO:teuthology.orchestra.run.smithi036.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T11:49:19.761 INFO:teuthology.orchestra.run.smithi036.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:49:19.761 INFO:teuthology.orchestra.run.smithi036.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:49:19.761 INFO:teuthology.orchestra.run.smithi036.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:49:19.761 INFO:teuthology.orchestra.run.smithi036.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T11:49:19.762 INFO:teuthology.orchestra.run.smithi036.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:49:19.762 INFO:teuthology.orchestra.run.smithi036.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T11:49:19.762 INFO:teuthology.orchestra.run.smithi036.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:49:19.762 INFO:teuthology.orchestra.run.smithi036.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T11:49:19.762 INFO:teuthology.orchestra.run.smithi036.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T11:49:19.763 INFO:teuthology.orchestra.run.smithi036.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T11:49:19.763 INFO:teuthology.orchestra.run.smithi036.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T11:49:19.763 INFO:teuthology.orchestra.run.smithi036.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T11:49:19.763 INFO:teuthology.orchestra.run.smithi036.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T11:49:19.763 INFO:teuthology.orchestra.run.smithi036.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T11:49:19.764 INFO:teuthology.orchestra.run.smithi036.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:49:19.764 INFO:teuthology.orchestra.run.smithi036.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T11:49:19.764 INFO:teuthology.orchestra.run.smithi036.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:49:19.764 INFO:teuthology.orchestra.run.smithi036.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:49:19.764 INFO:teuthology.orchestra.run.smithi036.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:49:19.765 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:49:19.765 INFO:teuthology.orchestra.run.smithi036.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.765 INFO:teuthology.orchestra.run.smithi036.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.765 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.765 INFO:teuthology.orchestra.run.smithi036.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:49:19.766 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T11:49:19.766 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:49:19.766 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:49:19.766 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T11:49:19.766 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:49:19.767 INFO:teuthology.orchestra.run.smithi036.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:49:19.767 INFO:teuthology.orchestra.run.smithi036.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:49:19.767 INFO:teuthology.orchestra.run.smithi036.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:49:19.767 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:49:19.767 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:49:19.768 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:49:19.768 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:49:19.768 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:49:19.768 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:49:19.768 INFO:teuthology.orchestra.run.smithi036.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:49:19.769 INFO:teuthology.orchestra.run.smithi036.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:49:19.769 INFO:teuthology.orchestra.run.smithi036.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:49:19.769 INFO:teuthology.orchestra.run.smithi036.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:49:19.769 INFO:teuthology.orchestra.run.smithi036.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:49:19.769 INFO:teuthology.orchestra.run.smithi036.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:49:19.770 INFO:teuthology.orchestra.run.smithi036.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:49:19.770 INFO:teuthology.orchestra.run.smithi036.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:49:19.770 INFO:teuthology.orchestra.run.smithi036.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:49:19.770 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:49:19.770 INFO:teuthology.orchestra.run.smithi036.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:49:19.771 INFO:teuthology.orchestra.run.smithi036.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:49:19.771 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T11:49:19.771 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:49:19.771 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:49:19.772 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T11:49:19.772 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:49:19.772 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.772 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.772 INFO:teuthology.orchestra.run.smithi036.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:49:19.773 INFO:teuthology.orchestra.run.smithi036.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:49:19.773 INFO:teuthology.orchestra.run.smithi036.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:49:19.773 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.773 INFO:teuthology.orchestra.run.smithi036.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:49:19.773 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:49:19.774 INFO:teuthology.orchestra.run.smithi036.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T11:49:19.774 INFO:teuthology.orchestra.run.smithi036.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:49:19.774 INFO:teuthology.orchestra.run.smithi036.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:49:19.774 INFO:teuthology.orchestra.run.smithi036.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:49:19.774 INFO:teuthology.orchestra.run.smithi036.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:49:19.775 INFO:teuthology.orchestra.run.smithi036.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:49:19.775 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:49:19.775 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:49:19.775 INFO:teuthology.orchestra.run.smithi036.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:49:19.775 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:49:19.776 INFO:teuthology.orchestra.run.smithi036.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:49:19.776 INFO:teuthology.orchestra.run.smithi036.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:49:19.776 INFO:teuthology.orchestra.run.smithi036.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.776 INFO:teuthology.orchestra.run.smithi036.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.776 INFO:teuthology.orchestra.run.smithi036.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:19.777 INFO:teuthology.orchestra.run.smithi036.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T11:49:19.777 INFO:teuthology.orchestra.run.smithi036.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T11:49:19.777 INFO:teuthology.orchestra.run.smithi036.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:49:19.777 INFO:teuthology.orchestra.run.smithi036.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T11:49:19.777 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:19.778 INFO:teuthology.orchestra.run.smithi036.stdout:Complete! 2020-11-20T11:49:19.994 DEBUG:teuthology.parallel:result is None 2020-11-20T11:49:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:21.300 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2020-11-20T11:49:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:49:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.302 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:21.302 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2020-11-20T11:49:21.302 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:49:21.302 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:49:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:49:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T11:49:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:49:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:49:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:49:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:49:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:49:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:49:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:49:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T11:49:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:49:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:49:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T11:49:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T11:49:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:49:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T11:49:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T11:49:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:49:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T11:49:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:49:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:49:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:49:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T11:49:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:49:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T11:49:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:49:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T11:49:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T11:49:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T11:49:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T11:49:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T11:49:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T11:49:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T11:49:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:49:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T11:49:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:49:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:49:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:49:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:49:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:49:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T11:49:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:49:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:49:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T11:49:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:49:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:49:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:49:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:49:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:49:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:49:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:49:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:49:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:49:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:49:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:49:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:49:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:49:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:49:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:49:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:49:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:49:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:49:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:49:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:49:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:49:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:49:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T11:49:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:49:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:49:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T11:49:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:49:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:49:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:49:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:49:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:49:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:49:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T11:49:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:49:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:49:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:49:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:49:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:49:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:49:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:49:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:49:21.334 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:49:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:49:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:49:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.335 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:49:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T11:49:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T11:49:21.336 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:49:21.337 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T11:49:21.337 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:21.338 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2020-11-20T11:49:21.482 DEBUG:teuthology.parallel:result is None 2020-11-20T11:49:21.483 INFO:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2020-11-20T11:49:21.531 INFO:teuthology.orchestra.run.smithi164.stdout:RedHatEnterprise 2020-11-20T11:49:21.531 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:49:21.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:49:21.702 INFO:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:49:21.722 INFO:teuthology.orchestra.run.smithi164.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:49:21.722 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:49:21.723 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:49:21.724 INFO:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2020-11-20T11:49:21.778 INFO:teuthology.orchestra.run.smithi036.stdout:RedHatEnterprise 2020-11-20T11:49:21.779 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:49:21.780 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:49:21.943 INFO:teuthology.orchestra.run.smithi036:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:49:21.966 INFO:teuthology.orchestra.run.smithi036.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:49:21.967 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:49:21.967 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:49:21.967 INFO:teuthology.orchestra.run.smithi188:> sudo lsb_release -is 2020-11-20T11:49:22.019 INFO:teuthology.orchestra.run.smithi188.stdout:RedHatEnterprise 2020-11-20T11:49:22.020 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:49:22.021 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:49:22.187 INFO:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:49:22.209 INFO:teuthology.orchestra.run.smithi188.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:49:22.210 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:49:22.210 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:49:22.211 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-20T11:49:22.211 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:49:22.211 INFO:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:49:22.225 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:49:22.236 INFO:teuthology.orchestra.run.smithi164.stderr:24+1 records in 2020-11-20T11:49:22.237 INFO:teuthology.orchestra.run.smithi164.stderr:24+1 records out 2020-11-20T11:49:22.237 INFO:teuthology.orchestra.run.smithi164.stderr:12667 bytes (13 kB, 12 KiB) copied, 7.644e-05 s, 166 MB/s 2020-11-20T11:49:22.238 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:49:22.238 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:49:22.256 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:49:22.268 INFO:teuthology.orchestra.run.smithi036.stderr:24+1 records in 2020-11-20T11:49:22.268 INFO:teuthology.orchestra.run.smithi036.stderr:24+1 records out 2020-11-20T11:49:22.269 INFO:teuthology.orchestra.run.smithi036.stderr:12667 bytes (13 kB, 12 KiB) copied, 9.2673e-05 s, 137 MB/s 2020-11-20T11:49:22.270 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:49:22.270 INFO:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:49:22.285 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:49:22.296 INFO:teuthology.orchestra.run.smithi188.stderr:24+1 records in 2020-11-20T11:49:22.296 INFO:teuthology.orchestra.run.smithi188.stderr:24+1 records out 2020-11-20T11:49:22.297 INFO:teuthology.orchestra.run.smithi188.stderr:12667 bytes (13 kB, 12 KiB) copied, 7.893e-05 s, 160 MB/s 2020-11-20T11:49:22.298 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-20T11:49:22.298 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:49:22.298 INFO:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:49:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:49:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:5+1 records in 2020-11-20T11:49:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:5+1 records out 2020-11-20T11:49:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 3.6638e-05 s, 83.5 MB/s 2020-11-20T11:49:22.325 INFO:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:49:22.390 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:49:22.391 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:49:22.407 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:49:22.419 INFO:teuthology.orchestra.run.smithi036.stderr:5+1 records in 2020-11-20T11:49:22.419 INFO:teuthology.orchestra.run.smithi036.stderr:5+1 records out 2020-11-20T11:49:22.420 INFO:teuthology.orchestra.run.smithi036.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.9782e-05 s, 61.4 MB/s 2020-11-20T11:49:22.421 INFO:teuthology.orchestra.run.smithi036:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:49:22.489 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:49:22.489 INFO:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:49:22.505 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:49:22.516 INFO:teuthology.orchestra.run.smithi188.stderr:5+1 records in 2020-11-20T11:49:22.517 INFO:teuthology.orchestra.run.smithi188.stderr:5+1 records out 2020-11-20T11:49:22.517 INFO:teuthology.orchestra.run.smithi188.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.4805e-05 s, 68.3 MB/s 2020-11-20T11:49:22.518 INFO:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:49:22.585 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-20T11:49:22.585 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:49:22.586 INFO:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:49:22.599 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:49:22.609 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:49:22.609 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:49:22.610 INFO:teuthology.orchestra.run.smithi164.stderr:299 bytes copied, 3.22e-05 s, 9.3 MB/s 2020-11-20T11:49:22.611 INFO:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:49:22.675 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:49:22.676 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:49:22.692 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:49:22.704 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:49:22.704 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:49:22.704 INFO:teuthology.orchestra.run.smithi036.stderr:299 bytes copied, 3.6478e-05 s, 8.2 MB/s 2020-11-20T11:49:22.705 INFO:teuthology.orchestra.run.smithi036:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:49:22.773 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:49:22.774 INFO:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:49:22.790 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:49:22.801 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:49:22.801 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:49:22.801 INFO:teuthology.orchestra.run.smithi188.stderr:299 bytes copied, 3.2705e-05 s, 9.1 MB/s 2020-11-20T11:49:22.802 INFO:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:49:22.869 INFO:teuthology.run_tasks:Running task ceph... 2020-11-20T11:49:22.963 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-11-20T11:49:23.156 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 777 /var/log/ceph 2020-11-20T11:49:23.171 INFO:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2020-11-20T11:49:23.182 INFO:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2020-11-20T11:49:23.217 INFO:tasks.ceph:Disabling ceph logrotate... 2020-11-20T11:49:23.218 INFO:teuthology.orchestra.run.smithi036:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:49:23.244 INFO:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:49:23.259 INFO:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:49:23.288 INFO:tasks.ceph:Creating extra log directories... 2020-11-20T11:49:23.288 INFO:teuthology.orchestra.run.smithi036:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:49:23.314 INFO:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:49:23.330 INFO:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:49:23.384 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-11-20T11:49:23.385 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-11-20T11:49:23.385 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-11-20T11:49:23.386 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:49:23.386 INFO:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:49:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:49:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:49:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:49:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:408 bytes copied, 0.000935165 s, 436 kB/s 2020-11-20T11:49:23.411 INFO:teuthology.orchestra.run.smithi164:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:23.513 INFO:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:23.559 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:49:23.560 INFO:teuthology.orchestra.run.smithi036:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:49:23.577 INFO:teuthology.orchestra.run.smithi036.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:49:23.578 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:49:23.578 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:49:23.578 INFO:teuthology.orchestra.run.smithi036.stderr:408 bytes copied, 3.9753e-05 s, 10.3 MB/s 2020-11-20T11:49:23.579 INFO:teuthology.orchestra.run.smithi036:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:23.691 INFO:teuthology.orchestra.run.smithi036:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:23.719 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:49:23.720 INFO:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:49:23.736 INFO:teuthology.orchestra.run.smithi188.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:49:23.737 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:49:23.737 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:49:23.737 INFO:teuthology.orchestra.run.smithi188.stderr:408 bytes copied, 5.846e-05 s, 7.0 MB/s 2020-11-20T11:49:23.738 INFO:teuthology.orchestra.run.smithi188:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:23.847 INFO:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:23.885 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-11-20T11:49:23.885 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-11-20T11:49:23.886 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290', 'branch': 'wip-pdonnell-testing-20201120.053228', 'description': 'fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/iogen}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '5640290', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20201120.053228'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20201120.053228', 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 95, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20201120.053228', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (3, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/iogen.sh']}}}], 'teuthology_branch': 'master', 'timestamp': '2020-11-20_08:39:42', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.6036', 'targets': {'smithi164.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxZnlEauJTFlRHPfCi3blevDcgdbQgA2KRj1db9LLxnm8O9zVI2MPatcqfab3nVkrt0Pddbcf619mx5IWrh3XQvfuR/6sw9f6a8O5cdgcwyYYGH/NediB7qbWbAgXgot8wNSy/lTyh6j0cpLWO5OePzJF7uhc9ZRkHKrHSgyEwUNzO/J6Wwvd62V09W42enZ1jEBD37UB7EXfO7oZmwImq2cijuX8LGZWvvhFSfBSwdVWxDTWNiuhYlHoH8XBNGiI6Tw+yGCAVHJq+XmHQDsx+WOLwE1vfNPFWB57cQmSnbKyDNINV3aIBQgiO+8f/hPlLffNh/7iiDEVfEJoMc5GPw9hE5pz4DJtRDBUGYxU55Rnl6qddkDin13T9roSjZ0xlIYd86kkIK+akfRkZJ1TdSkoLFgT6vc/T+dKLUnBGDNxYfFeSj7QMhu3O0C0md5jWrUTgJokAEULO5N0fd7TEn0FAgu22mH4rpp3XGXdzY7oBwYtXiQPd6xZUdBz4Kws=', 'smithi036.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEqXMc96dndE8R4ZjUa16wC0s8WdO3+vNSClbZCLSZeJXjrKnvbbJFky6IP+TSNZ7OVtzKazeYHlIsobeFmnkEXOI0S5a0DbKgyCGnsCPBoWY0FD0FUCPTPqULQxMWww7d1/Tk1kODo5+0oJ4hefPBq8MDNzuyUayuN8SUeHhbvl2hwC0X59uQ5vRbgHy1LqFa2kzbM61QqedBhAnDKPE/09dVEfM+vtbh50X/EkDCmNcLqjosmGOxnNnst+2fFihnBhCKK10wlXBlcz8jmNweIfqZlEP5OjevrbUhA1WQQ+PR1hafs6VqdR8Bwlc35GsbMAIJoFENQwoqubkmLEz2u6ONty6a4VUYhMEkOnbVgGe91PZlSY+kjWbzhh279+l6LicZ6vjU7YhZXOcddJxqlsQ+bGX4Jkd2YQF57ufkBTSoiD1T11FfAjN3rn7xTDsOtGS9bIadlhcmbS7WhhnXvpSuzF8/j7c0SfRW+ii/2Ul57yTcoweOTwbbInKrRIM=', 'smithi188.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2mg53g+4UruO6CxZ5tNMLQrkafHZYs2F1S7U47UuDFUQVcRYZlV0uJYRxARZ7QsC9mPhnyDOMkfzPRscS5e2QRsNqdxTpK4XtRt6h6vCnquomrF4uFo0v+yTh75Y7N/4ft4bR6aK4G/CdB8RYq+xFAjjKSZvJO0DMxOwSaDMzttWfdoOCRia/+zehdsxajJ9G8RUg0sl/8ZKnRXq5zGOegDukxlJmzFPBlqBGBWwMHVegljoH/UFOtFaecjtgMycXRE/C73NbcLTNTOBDPRGggCLaV2hxtIYa0abZ/RdJ1Gi+8bQWQwGdP6XJFym1oNR6iHzZZoqBN29UJc1Cn1yU5zXw4sEUeIEVMwByNwaXcLkg/Yiyo/DDAa0jXD/pK2bhvcx6Z8DdyntJOt/tMyxTPxOR4OB0Dcm4QqtnvXNzmeO1NbcqhewH+nw7lmLN3Jy37YGYOaQ4+/NidPcpakcvDF1SflMgoyC3dgz7CdWPZiXEL2ehEBDamNWNF0eDwyk='}} 2020-11-20T11:49:23.887 INFO:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:49:23.890 INFO:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:49:23.892 INFO:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:49:23.930 INFO:teuthology.orchestra.run.smithi036:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:49:23.946 INFO:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:49:23.948 INFO:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:49:23.995 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:49:23.995 INFO:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:49:24.023 INFO:teuthology.orchestra.run.smithi164.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:49:24.025 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:49:24.025 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:49:24.025 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:49:24.025 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:49:24.026 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:49:24.026 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:49:24.026 INFO:teuthology.orchestra.run.smithi164.stderr:72 bytes copied, 3.2983e-05 s, 2.2 MB/s 2020-11-20T11:49:24.027 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:49:24.027 INFO:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:49:24.079 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:49:24.080 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.080 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 59529 Links: 1 2020-11-20T11:49:24.081 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.081 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.082 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2020-11-20 11:49:16.503489180 +0000 2020-11-20T11:49:24.082 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2020-11-20 11:47:08.579545561 +0000 2020-11-20T11:49:24.082 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2020-11-20 11:47:08.579545561 +0000 2020-11-20T11:49:24.083 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2020-11-20T11:49:24.090 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2020-11-20T11:49:24.090 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2020-11-20T11:49:24.090 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000244038 s, 2.1 MB/s 2020-11-20T11:49:24.093 INFO:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:49:24.147 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:49:24.148 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.148 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 54262 Links: 1 2020-11-20T11:49:24.149 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.149 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.149 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2020-11-20 11:49:16.504489162 +0000 2020-11-20T11:49:24.149 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2020-11-20 11:47:08.896540268 +0000 2020-11-20T11:49:24.150 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2020-11-20 11:47:08.896540268 +0000 2020-11-20T11:49:24.150 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2020-11-20T11:49:24.156 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2020-11-20T11:49:24.156 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2020-11-20T11:49:24.156 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.00021954 s, 2.3 MB/s 2020-11-20T11:49:24.158 INFO:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:49:24.218 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:49:24.218 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.219 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 59564 Links: 1 2020-11-20T11:49:24.219 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.219 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.219 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2020-11-20 11:49:16.504489162 +0000 2020-11-20T11:49:24.219 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2020-11-20 11:47:09.203535143 +0000 2020-11-20T11:49:24.220 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2020-11-20 11:47:09.203535143 +0000 2020-11-20T11:49:24.220 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2020-11-20T11:49:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2020-11-20T11:49:24.228 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2020-11-20T11:49:24.228 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.00023807 s, 2.2 MB/s 2020-11-20T11:49:24.230 INFO:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:49:24.260 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:49:24.260 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.261 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 58186 Links: 1 2020-11-20T11:49:24.261 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.261 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.261 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2020-11-20 11:49:16.504489162 +0000 2020-11-20T11:49:24.262 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2020-11-20 11:47:09.527529734 +0000 2020-11-20T11:49:24.262 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2020-11-20 11:47:09.527529734 +0000 2020-11-20T11:49:24.262 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2020-11-20T11:49:24.270 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2020-11-20T11:49:24.270 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2020-11-20T11:49:24.270 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000219774 s, 2.3 MB/s 2020-11-20T11:49:24.272 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:24.273 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:49:24.275 INFO:teuthology.orchestra.run.smithi036:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:49:24.308 INFO:teuthology.orchestra.run.smithi036.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:49:24.309 INFO:teuthology.orchestra.run.smithi036.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:49:24.309 INFO:teuthology.orchestra.run.smithi036.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:49:24.309 INFO:teuthology.orchestra.run.smithi036.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:49:24.309 INFO:teuthology.orchestra.run.smithi036.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:49:24.310 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:49:24.310 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:49:24.310 INFO:teuthology.orchestra.run.smithi036.stderr:72 bytes copied, 4.7017e-05 s, 1.5 MB/s 2020-11-20T11:49:24.310 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:49:24.311 INFO:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:49:24.399 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:49:24.399 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.400 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 56755 Links: 1 2020-11-20T11:49:24.400 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.400 INFO:teuthology.orchestra.run.smithi036.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.400 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2020-11-20 11:49:14.933015831 +0000 2020-11-20T11:49:24.400 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2020-11-20 11:47:11.868073283 +0000 2020-11-20T11:49:24.401 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2020-11-20 11:47:11.868073283 +0000 2020-11-20T11:49:24.401 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2020-11-20T11:49:24.411 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2020-11-20T11:49:24.411 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2020-11-20T11:49:24.411 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000267879 s, 1.9 MB/s 2020-11-20T11:49:24.414 INFO:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:49:24.441 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:49:24.442 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.442 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 60033 Links: 1 2020-11-20T11:49:24.442 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.442 INFO:teuthology.orchestra.run.smithi036.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.443 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2020-11-20 11:49:14.933015831 +0000 2020-11-20T11:49:24.443 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2020-11-20 11:47:12.219070097 +0000 2020-11-20T11:49:24.443 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2020-11-20 11:47:12.219070097 +0000 2020-11-20T11:49:24.443 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2020-11-20T11:49:24.453 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2020-11-20T11:49:24.453 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2020-11-20T11:49:24.454 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000232945 s, 2.2 MB/s 2020-11-20T11:49:24.456 INFO:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:49:24.520 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:49:24.521 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.521 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 54249 Links: 1 2020-11-20T11:49:24.521 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.521 INFO:teuthology.orchestra.run.smithi036.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.522 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2020-11-20 11:49:14.933015831 +0000 2020-11-20T11:49:24.522 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2020-11-20 11:47:12.574066874 +0000 2020-11-20T11:49:24.522 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2020-11-20 11:47:12.574066874 +0000 2020-11-20T11:49:24.522 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2020-11-20T11:49:24.532 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2020-11-20T11:49:24.532 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2020-11-20T11:49:24.532 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000233142 s, 2.2 MB/s 2020-11-20T11:49:24.538 INFO:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:49:24.598 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:49:24.599 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.599 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 56207 Links: 1 2020-11-20T11:49:24.599 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.600 INFO:teuthology.orchestra.run.smithi036.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.600 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2020-11-20 11:49:14.933015831 +0000 2020-11-20T11:49:24.600 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2020-11-20 11:47:12.932063624 +0000 2020-11-20T11:49:24.600 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2020-11-20 11:47:12.932063624 +0000 2020-11-20T11:49:24.600 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2020-11-20T11:49:24.610 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2020-11-20T11:49:24.610 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2020-11-20T11:49:24.610 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000206105 s, 2.5 MB/s 2020-11-20T11:49:24.613 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:24.613 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:49:24.614 INFO:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:49:24.639 INFO:teuthology.orchestra.run.smithi188.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:49:24.641 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:49:24.642 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:49:24.642 INFO:teuthology.orchestra.run.smithi188.stderr:72 bytes copied, 4.0541e-05 s, 1.8 MB/s 2020-11-20T11:49:24.642 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:49:24.642 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:49:24.643 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:49:24.643 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:49:24.643 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:49:24.644 INFO:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:49:24.701 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:49:24.703 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.703 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 56230 Links: 1 2020-11-20T11:49:24.704 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.705 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.705 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2020-11-20 11:49:06.878305670 +0000 2020-11-20T11:49:24.706 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2020-11-20 11:47:10.105178692 +0000 2020-11-20T11:49:24.707 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2020-11-20 11:47:10.105178692 +0000 2020-11-20T11:49:24.708 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2020-11-20T11:49:24.713 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2020-11-20T11:49:24.713 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2020-11-20T11:49:24.713 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000280224 s, 1.8 MB/s 2020-11-20T11:49:24.718 INFO:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:49:24.784 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:49:24.786 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.788 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 53991 Links: 1 2020-11-20T11:49:24.790 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.791 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.791 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2020-11-20 11:49:06.878305670 +0000 2020-11-20T11:49:24.792 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2020-11-20 11:47:10.433172894 +0000 2020-11-20T11:49:24.792 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2020-11-20 11:47:10.433172894 +0000 2020-11-20T11:49:24.792 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2020-11-20T11:49:24.794 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2020-11-20T11:49:24.796 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2020-11-20T11:49:24.797 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000262641 s, 1.9 MB/s 2020-11-20T11:49:24.798 INFO:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:49:24.858 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:49:24.859 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.859 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 57852 Links: 1 2020-11-20T11:49:24.860 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.860 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.861 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2020-11-20 11:49:06.878305670 +0000 2020-11-20T11:49:24.861 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2020-11-20 11:47:10.774166866 +0000 2020-11-20T11:49:24.861 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2020-11-20 11:47:10.774166866 +0000 2020-11-20T11:49:24.862 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2020-11-20T11:49:24.871 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2020-11-20T11:49:24.871 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2020-11-20T11:49:24.872 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000243435 s, 2.1 MB/s 2020-11-20T11:49:24.874 INFO:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:49:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:49:24.934 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:49:24.934 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 6h/6d Inode: 59669 Links: 1 2020-11-20T11:49:24.935 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:49:24.935 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:49:24.935 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2020-11-20 11:49:06.878305670 +0000 2020-11-20T11:49:24.935 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2020-11-20 11:47:11.112160890 +0000 2020-11-20T11:49:24.935 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2020-11-20 11:47:11.112160890 +0000 2020-11-20T11:49:24.936 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2020-11-20T11:49:24.945 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2020-11-20T11:49:24.946 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2020-11-20T11:49:24.946 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000240344 s, 2.1 MB/s 2020-11-20T11:49:24.950 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:24.952 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi036.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T11:49:24.952 INFO:tasks.ceph:Generating config... 2020-11-20T11:49:24.958 INFO:tasks.ceph:[client] client mount timeout = 600 2020-11-20T11:49:24.961 INFO:tasks.ceph:[client] debug client = 20 2020-11-20T11:49:24.961 INFO:tasks.ceph:[client] debug ms = 1 2020-11-20T11:49:24.962 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2020-11-20T11:49:24.962 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2020-11-20T11:49:24.962 INFO:tasks.ceph:[mds] debug mds = 20 2020-11-20T11:49:24.963 INFO:tasks.ceph:[mds] debug ms = 1 2020-11-20T11:49:24.963 INFO:tasks.ceph:[mds] mds bal frag = True 2020-11-20T11:49:24.964 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-11-20T11:49:24.964 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-11-20T11:49:24.964 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-11-20T11:49:24.965 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-11-20T11:49:24.968 INFO:tasks.ceph:[mds] mds debug frag = True 2020-11-20T11:49:24.969 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-11-20T11:49:24.970 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-11-20T11:49:24.971 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-11-20T11:49:24.972 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-11-20T11:49:24.972 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2020-11-20T11:49:24.973 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2020-11-20T11:49:24.974 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-11-20T11:49:24.974 INFO:tasks.ceph:[mgr] debug ms = 1 2020-11-20T11:49:24.974 INFO:tasks.ceph:[mon] debug mon = 20 2020-11-20T11:49:24.974 INFO:tasks.ceph:[mon] debug ms = 1 2020-11-20T11:49:24.975 INFO:tasks.ceph:[mon] debug paxos = 20 2020-11-20T11:49:24.975 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-11-20T11:49:24.975 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-11-20T11:49:24.976 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-11-20T11:49:24.976 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-11-20T11:49:24.976 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-11-20T11:49:24.976 INFO:tasks.ceph:[osd] debug filestore = 20 2020-11-20T11:49:24.977 INFO:tasks.ceph:[osd] debug journal = 20 2020-11-20T11:49:24.977 INFO:tasks.ceph:[osd] debug ms = 20 2020-11-20T11:49:24.977 INFO:tasks.ceph:[osd] debug osd = 25 2020-11-20T11:49:24.977 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-11-20T11:49:24.978 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-11-20T11:49:24.978 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-11-20T11:49:24.978 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-11-20T11:49:24.979 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-11-20T11:49:24.979 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-11-20T11:49:24.979 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-11-20T11:49:24.979 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-11-20T11:49:24.980 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10000 2020-11-20T11:49:24.980 INFO:tasks.ceph:Setting up mon.a... 2020-11-20T11:49:24.980 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-11-20T11:49:25.036 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.keyring 2020-11-20T11:49:25.038 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-11-20T11:49:25.094 INFO:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:49:25.170 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.164'), ('mon.b', '172.21.15.36'), ('mon.c', '172.21.15.188')] 2020-11-20T11:49:25.172 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.164,172.21.15.36,172.21.15.188'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}} 2020-11-20T11:49:25.173 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:49:25.174 INFO:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:49:25.227 INFO:teuthology.orchestra.run.smithi164.stderr:+ dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:49:25.229 INFO:teuthology.orchestra.run.smithi164.stderr:6+1 records in 2020-11-20T11:49:25.229 INFO:teuthology.orchestra.run.smithi164.stderr:6+1 records out 2020-11-20T11:49:25.229 INFO:teuthology.orchestra.run.smithi164.stderr:3469 bytes (3.5 kB, 3.4 KiB) copied, 4.402e-05 s, 78.8 MB/s 2020-11-20T11:49:25.229 INFO:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.164 --add b 172.21.15.36 --add c 172.21.15.188 --print /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:25.312 INFO:teuthology.orchestra.run.smithi164.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:25.313 INFO:teuthology.orchestra.run.smithi164.stdout:monmaptool: generated fsid 8d9b76f1-9267-4076-877e-b8d77372c9f3 2020-11-20T11:49:25.313 INFO:teuthology.orchestra.run.smithi164.stdout:epoch 0 2020-11-20T11:49:25.313 INFO:teuthology.orchestra.run.smithi164.stdout:fsid 8d9b76f1-9267-4076-877e-b8d77372c9f3 2020-11-20T11:49:25.314 INFO:teuthology.orchestra.run.smithi164.stdout:last_changed 2020-11-20T11:49:25.310823+0000 2020-11-20T11:49:25.314 INFO:teuthology.orchestra.run.smithi164.stdout:created 2020-11-20T11:49:25.310823+0000 2020-11-20T11:49:25.314 INFO:teuthology.orchestra.run.smithi164.stdout:min_mon_release 0 (unknown) 2020-11-20T11:49:25.314 INFO:teuthology.orchestra.run.smithi164.stdout:election_strategy: 1 2020-11-20T11:49:25.314 INFO:teuthology.orchestra.run.smithi164.stdout:0: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.a 2020-11-20T11:49:25.315 INFO:teuthology.orchestra.run.smithi164.stdout:1: [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] mon.b 2020-11-20T11:49:25.315 INFO:teuthology.orchestra.run.smithi164.stdout:2: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.c 2020-11-20T11:49:25.315 INFO:teuthology.orchestra.run.smithi164.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-11-20T11:49:25.316 INFO:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:49:25.373 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8d9b76f1-9267-4076-877e-b8d77372c9f3... 2020-11-20T11:49:25.374 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:49:25.385 INFO:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:49:25.420 INFO:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:49:25.432 INFO:teuthology.orchestra.run.smithi036.stdout:[global] 2020-11-20T11:49:25.433 INFO:teuthology.orchestra.run.smithi036.stdout: chdir = "" 2020-11-20T11:49:25.433 INFO:teuthology.orchestra.run.smithi036.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:49:25.433 INFO:teuthology.orchestra.run.smithi036.stdout: auth supported = cephx 2020-11-20T11:49:25.434 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.434 INFO:teuthology.orchestra.run.smithi036.stdout: filestore xattr use omap = true 2020-11-20T11:49:25.434 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.434 INFO:teuthology.orchestra.run.smithi036.stdout: mon clock drift allowed = 1.000 2020-11-20T11:49:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: osd crush chooseleaf type = 0 2020-11-20T11:49:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: auth debug = true 2020-11-20T11:49:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on old message = true 2020-11-20T11:49:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on bug = true 2020-11-20T11:49:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:49:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: mon pg warn max object skew = 0 2020-11-20T11:49:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.437 INFO:teuthology.orchestra.run.smithi036.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:49:25.437 INFO:teuthology.orchestra.run.smithi036.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:49:25.437 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.437 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default size = 2 2020-11-20T11:49:25.437 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.438 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow primary affinity = true 2020-11-20T11:49:25.438 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow pg remap = true 2020-11-20T11:49:25.438 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:49:25.438 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:49:25.438 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on no sortbitwise = false 2020-11-20T11:49:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:49:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on too few osds = false 2020-11-20T11:49:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:49:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:49:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: mon_allow_pool_size_one = true 2020-11-20T11:49:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:49:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: osd default data pool replay window = 5 2020-11-20T11:49:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: mon allow pool delete = true 2020-11-20T11:49:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: mon cluster log file level = debug 2020-11-20T11:49:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: debug asserts on shutdown = true 2020-11-20T11:49:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: mon health detail to clog = false 2020-11-20T11:49:25.442 INFO:teuthology.orchestra.run.smithi036.stdout: mon host = "172.21.15.164,172.21.15.36,172.21.15.188" 2020-11-20T11:49:25.442 INFO:teuthology.orchestra.run.smithi036.stdout: fsid = 8d9b76f1-9267-4076-877e-b8d77372c9f3 2020-11-20T11:49:25.442 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.442 INFO:teuthology.orchestra.run.smithi036.stdout:[osd] 2020-11-20T11:49:25.442 INFO:teuthology.orchestra.run.smithi036.stdout: osd journal size = 100 2020-11-20T11:49:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub load threshold = 5.0 2020-11-20T11:49:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub max interval = 600 2020-11-20T11:49:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: osd recover clone overlap = true 2020-11-20T11:49:25.444 INFO:teuthology.orchestra.run.smithi036.stdout: osd recovery max chunk = 1048576 2020-11-20T11:49:25.444 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.445 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug shutdown = true 2020-11-20T11:49:25.446 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug op order = true 2020-11-20T11:49:25.447 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug verify stray on activate = true 2020-11-20T11:49:25.448 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.449 INFO:teuthology.orchestra.run.smithi036.stdout: osd open classes on start = true 2020-11-20T11:49:25.450 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug pg log writeout = true 2020-11-20T11:49:25.451 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.452 INFO:teuthology.orchestra.run.smithi036.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:49:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: osd map max advance = 10 2020-11-20T11:49:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: journal zero on create = true 2020-11-20T11:49:25.454 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.454 INFO:teuthology.orchestra.run.smithi036.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:49:25.454 INFO:teuthology.orchestra.run.smithi036.stdout: filestore apply finisher threads = 3 2020-11-20T11:49:25.454 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: bdev debug aio = true 2020-11-20T11:49:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug misdirected ops = true 2020-11-20T11:49:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore block size = 96636764160 2020-11-20T11:49:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore fsck on mount = True 2020-11-20T11:49:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluefs = 20 2020-11-20T11:49:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluestore = 20 2020-11-20T11:49:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: debug filestore = 20 2020-11-20T11:49:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: debug journal = 20 2020-11-20T11:49:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 20 2020-11-20T11:49:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: debug osd = 25 2020-11-20T11:49:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: debug rocksdb = 10 2020-11-20T11:49:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:49:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd full ratio = 0.9 2020-11-20T11:49:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:49:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:49:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: osd objectstore = bluestore 2020-11-20T11:49:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2020-11-20T11:49:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: osd shutdown pgref assert = True 2020-11-20T11:49:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: osd_max_omap_entries_per_request = 10000 2020-11-20T11:49:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.459 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr] 2020-11-20T11:49:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2020-11-20T11:49:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: debug mgr = 20 2020-11-20T11:49:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2020-11-20T11:49:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2020-11-20T11:49:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:49:25.460 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:49:25.460 INFO:teuthology.orchestra.run.smithi036.stdout: mgr/telemetry/nag = false 2020-11-20T11:49:25.460 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.460 INFO:teuthology.orchestra.run.smithi036.stdout:[mon] 2020-11-20T11:49:25.460 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2020-11-20T11:49:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2020-11-20T11:49:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: debug paxos = 20 2020-11-20T11:49:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2020-11-20T11:49:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: mon data avail warn = 5 2020-11-20T11:49:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: mon mgr mkfs grace = 240 2020-11-20T11:49:25.462 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:49:25.462 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd reporter subtree level = osd 2020-11-20T11:49:25.462 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd prime pg temp = true 2020-11-20T11:49:25.462 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:49:25.462 INFO:teuthology.orchestra.run.smithi036.stdout: mon op complaint time = 120 2020-11-20T11:49:25.463 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-20T11:49:25.463 INFO:teuthology.orchestra.run.smithi036.stdout:[client] 2020-11-20T11:49:25.463 INFO:teuthology.orchestra.run.smithi036.stdout: rgw cache enabled = true 2020-11-20T11:49:25.463 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable ops log = true 2020-11-20T11:49:25.463 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable usage log = true 2020-11-20T11:49:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:49:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:49:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: client mount timeout = 600 2020-11-20T11:49:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: debug client = 20 2020-11-20T11:49:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2020-11-20T11:49:25.465 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2020-11-20T11:49:25.465 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2020-11-20T11:49:25.465 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.a] 2020-11-20T11:49:25.465 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.b] 2020-11-20T11:49:25.465 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.c] 2020-11-20T11:49:25.466 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.a] 2020-11-20T11:49:25.466 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.b] 2020-11-20T11:49:25.466 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.c] 2020-11-20T11:49:25.466 INFO:teuthology.orchestra.run.smithi036.stdout:[mds] 2020-11-20T11:49:25.466 INFO:teuthology.orchestra.run.smithi036.stdout: debug mds = 20 2020-11-20T11:49:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2020-11-20T11:49:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal frag = True 2020-11-20T11:49:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal fragment size max = 10000 2020-11-20T11:49:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal merge size = 5 2020-11-20T11:49:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split bits = 3 2020-11-20T11:49:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split size = 100 2020-11-20T11:49:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug frag = True 2020-11-20T11:49:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug scatterstat = True 2020-11-20T11:49:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: mds op complaint time = 180 2020-11-20T11:49:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: mds verify scatter = True 2020-11-20T11:49:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2020-11-20T11:49:25.469 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2020-11-20T11:49:25.469 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2020-11-20T11:49:25.470 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2020-11-20T11:49:25.471 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2020-11-20T11:49:25.471 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:49:25.471 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2020-11-20T11:49:25.471 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.471 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2020-11-20T11:49:25.472 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.472 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2020-11-20T11:49:25.472 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.472 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2020-11-20T11:49:25.472 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2020-11-20T11:49:25.473 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.473 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2020-11-20T11:49:25.473 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2020-11-20T11:49:25.473 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.473 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:49:25.474 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2020-11-20T11:49:25.474 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.474 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:49:25.474 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:49:25.474 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.475 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2020-11-20T11:49:25.475 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.475 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2020-11-20T11:49:25.475 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2020-11-20T11:49:25.475 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:49:25.476 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:49:25.476 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2020-11-20T11:49:25.476 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:49:25.476 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2020-11-20T11:49:25.476 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:49:25.476 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:49:25.477 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2020-11-20T11:49:25.477 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.477 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:49:25.477 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.477 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2020-11-20T11:49:25.478 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.478 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2020-11-20T11:49:25.478 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.478 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2020-11-20T11:49:25.478 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2020-11-20T11:49:25.479 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2020-11-20T11:49:25.479 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.164,172.21.15.36,172.21.15.188" 2020-11-20T11:49:25.479 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 8d9b76f1-9267-4076-877e-b8d77372c9f3 2020-11-20T11:49:25.479 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.479 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2020-11-20T11:49:25.480 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2020-11-20T11:49:25.480 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.480 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2020-11-20T11:49:25.480 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2020-11-20T11:49:25.480 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.481 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2020-11-20T11:49:25.481 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2020-11-20T11:49:25.481 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.481 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2020-11-20T11:49:25.481 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2020-11-20T11:49:25.482 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2020-11-20T11:49:25.482 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.482 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2020-11-20T11:49:25.482 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2020-11-20T11:49:25.482 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.483 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:49:25.483 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.483 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2020-11-20T11:49:25.483 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.483 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2020-11-20T11:49:25.484 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.484 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:49:25.484 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2020-11-20T11:49:25.484 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.484 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2020-11-20T11:49:25.484 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2020-11-20T11:49:25.485 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2020-11-20T11:49:25.485 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2020-11-20T11:49:25.485 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 20 2020-11-20T11:49:25.485 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2020-11-20T11:49:25.485 INFO:teuthology.orchestra.run.smithi164.stdout: debug filestore = 20 2020-11-20T11:49:25.486 INFO:teuthology.orchestra.run.smithi164.stdout: debug journal = 20 2020-11-20T11:49:25.486 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 20 2020-11-20T11:49:25.486 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 25 2020-11-20T11:49:25.486 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2020-11-20T11:49:25.486 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:49:25.487 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2020-11-20T11:49:25.487 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:49:25.487 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:49:25.487 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2020-11-20T11:49:25.487 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2020-11-20T11:49:25.488 INFO:teuthology.orchestra.run.smithi164.stdout: osd shutdown pgref assert = True 2020-11-20T11:49:25.488 INFO:teuthology.orchestra.run.smithi164.stdout: osd_max_omap_entries_per_request = 10000 2020-11-20T11:49:25.488 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.488 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2020-11-20T11:49:25.488 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2020-11-20T11:49:25.489 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2020-11-20T11:49:25.489 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2020-11-20T11:49:25.489 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2020-11-20T11:49:25.489 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:49:25.489 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:49:25.489 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2020-11-20T11:49:25.490 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.490 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2020-11-20T11:49:25.490 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2020-11-20T11:49:25.490 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2020-11-20T11:49:25.490 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2020-11-20T11:49:25.491 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2020-11-20T11:49:25.491 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2020-11-20T11:49:25.491 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2020-11-20T11:49:25.491 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:49:25.491 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2020-11-20T11:49:25.492 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2020-11-20T11:49:25.492 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:49:25.492 INFO:teuthology.orchestra.run.smithi164.stdout: mon op complaint time = 120 2020-11-20T11:49:25.492 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:49:25.492 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2020-11-20T11:49:25.493 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2020-11-20T11:49:25.493 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2020-11-20T11:49:25.493 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2020-11-20T11:49:25.493 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:49:25.493 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:49:25.494 INFO:teuthology.orchestra.run.smithi164.stdout: client mount timeout = 600 2020-11-20T11:49:25.494 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2020-11-20T11:49:25.494 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2020-11-20T11:49:25.494 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 15m 2020-11-20T11:49:25.494 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 15m 2020-11-20T11:49:25.494 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2020-11-20T11:49:25.495 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2020-11-20T11:49:25.495 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2020-11-20T11:49:25.495 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2020-11-20T11:49:25.495 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2020-11-20T11:49:25.495 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2020-11-20T11:49:25.496 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2020-11-20T11:49:25.496 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds = 20 2020-11-20T11:49:25.496 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2020-11-20T11:49:25.496 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal frag = True 2020-11-20T11:49:25.496 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal fragment size max = 10000 2020-11-20T11:49:25.497 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal merge size = 5 2020-11-20T11:49:25.497 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal split bits = 3 2020-11-20T11:49:25.497 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal split size = 100 2020-11-20T11:49:25.497 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug frag = True 2020-11-20T11:49:25.497 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug scatterstat = True 2020-11-20T11:49:25.498 INFO:teuthology.orchestra.run.smithi164.stdout: mds op complaint time = 180 2020-11-20T11:49:25.498 INFO:teuthology.orchestra.run.smithi164.stdout: mds verify scatter = True 2020-11-20T11:49:25.498 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2020-11-20T11:49:25.498 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 15m 2020-11-20T11:49:25.498 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 15m 2020-11-20T11:49:25.499 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2020-11-20T11:49:25.500 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2020-11-20T11:49:25.500 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:49:25.500 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2020-11-20T11:49:25.500 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.501 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2020-11-20T11:49:25.501 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.501 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2020-11-20T11:49:25.501 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.501 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2020-11-20T11:49:25.502 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2020-11-20T11:49:25.502 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.502 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2020-11-20T11:49:25.502 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2020-11-20T11:49:25.502 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.503 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:49:25.503 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2020-11-20T11:49:25.503 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.503 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:49:25.503 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:49:25.504 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.504 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2020-11-20T11:49:25.504 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.504 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2020-11-20T11:49:25.504 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2020-11-20T11:49:25.505 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:49:25.505 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:49:25.505 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2020-11-20T11:49:25.505 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:49:25.505 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2020-11-20T11:49:25.506 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:49:25.506 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:49:25.506 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2020-11-20T11:49:25.506 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.506 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:49:25.507 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.507 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2020-11-20T11:49:25.507 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.507 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2020-11-20T11:49:25.507 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.508 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2020-11-20T11:49:25.508 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2020-11-20T11:49:25.508 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2020-11-20T11:49:25.508 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.164,172.21.15.36,172.21.15.188" 2020-11-20T11:49:25.508 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = 8d9b76f1-9267-4076-877e-b8d77372c9f3 2020-11-20T11:49:25.509 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.509 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2020-11-20T11:49:25.509 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2020-11-20T11:49:25.509 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.509 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2020-11-20T11:49:25.510 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2020-11-20T11:49:25.510 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.510 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2020-11-20T11:49:25.510 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2020-11-20T11:49:25.510 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.510 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2020-11-20T11:49:25.511 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2020-11-20T11:49:25.511 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2020-11-20T11:49:25.511 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.511 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2020-11-20T11:49:25.511 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2020-11-20T11:49:25.512 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.512 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:49:25.512 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.512 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2020-11-20T11:49:25.512 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.513 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2020-11-20T11:49:25.513 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.513 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:49:25.513 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2020-11-20T11:49:25.513 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.514 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2020-11-20T11:49:25.514 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2020-11-20T11:49:25.514 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2020-11-20T11:49:25.514 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2020-11-20T11:49:25.514 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 20 2020-11-20T11:49:25.515 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 20 2020-11-20T11:49:25.515 INFO:teuthology.orchestra.run.smithi188.stdout: debug filestore = 20 2020-11-20T11:49:25.515 INFO:teuthology.orchestra.run.smithi188.stdout: debug journal = 20 2020-11-20T11:49:25.515 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 20 2020-11-20T11:49:25.515 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 25 2020-11-20T11:49:25.516 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 10 2020-11-20T11:49:25.516 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:49:25.516 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2020-11-20T11:49:25.516 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:49:25.516 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:49:25.517 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2020-11-20T11:49:25.517 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2020-11-20T11:49:25.517 INFO:teuthology.orchestra.run.smithi188.stdout: osd shutdown pgref assert = True 2020-11-20T11:49:25.517 INFO:teuthology.orchestra.run.smithi188.stdout: osd_max_omap_entries_per_request = 10000 2020-11-20T11:49:25.517 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.518 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2020-11-20T11:49:25.518 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2020-11-20T11:49:25.518 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2020-11-20T11:49:25.518 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2020-11-20T11:49:25.518 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2020-11-20T11:49:25.519 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:49:25.519 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:49:25.519 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2020-11-20T11:49:25.519 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.519 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2020-11-20T11:49:25.520 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2020-11-20T11:49:25.520 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2020-11-20T11:49:25.520 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2020-11-20T11:49:25.520 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2020-11-20T11:49:25.520 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2020-11-20T11:49:25.521 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2020-11-20T11:49:25.521 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:49:25.521 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2020-11-20T11:49:25.521 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2020-11-20T11:49:25.521 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:49:25.521 INFO:teuthology.orchestra.run.smithi188.stdout: mon op complaint time = 120 2020-11-20T11:49:25.522 INFO:teuthology.orchestra.run.smithi188.stdout: 2020-11-20T11:49:25.522 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2020-11-20T11:49:25.522 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2020-11-20T11:49:25.522 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2020-11-20T11:49:25.522 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2020-11-20T11:49:25.523 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:49:25.523 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:49:25.523 INFO:teuthology.orchestra.run.smithi188.stdout: client mount timeout = 600 2020-11-20T11:49:25.523 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2020-11-20T11:49:25.523 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2020-11-20T11:49:25.524 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 15m 2020-11-20T11:49:25.524 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 15m 2020-11-20T11:49:25.524 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2020-11-20T11:49:25.524 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2020-11-20T11:49:25.524 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2020-11-20T11:49:25.525 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2020-11-20T11:49:25.525 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2020-11-20T11:49:25.525 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2020-11-20T11:49:25.525 INFO:teuthology.orchestra.run.smithi188.stdout:[mds] 2020-11-20T11:49:25.525 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds = 20 2020-11-20T11:49:25.526 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2020-11-20T11:49:25.526 INFO:teuthology.orchestra.run.smithi188.stdout: mds bal frag = True 2020-11-20T11:49:25.526 INFO:teuthology.orchestra.run.smithi188.stdout: mds bal fragment size max = 10000 2020-11-20T11:49:25.526 INFO:teuthology.orchestra.run.smithi188.stdout: mds bal merge size = 5 2020-11-20T11:49:25.526 INFO:teuthology.orchestra.run.smithi188.stdout: mds bal split bits = 3 2020-11-20T11:49:25.527 INFO:teuthology.orchestra.run.smithi188.stdout: mds bal split size = 100 2020-11-20T11:49:25.527 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug frag = True 2020-11-20T11:49:25.527 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug scatterstat = True 2020-11-20T11:49:25.527 INFO:teuthology.orchestra.run.smithi188.stdout: mds op complaint time = 180 2020-11-20T11:49:25.527 INFO:teuthology.orchestra.run.smithi188.stdout: mds verify scatter = True 2020-11-20T11:49:25.527 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2020-11-20T11:49:25.528 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 15m 2020-11-20T11:49:25.528 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 15m 2020-11-20T11:49:25.528 INFO:tasks.ceph:Creating admin key on mon.a... 2020-11-20T11:49:25.529 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-11-20T11:49:25.578 INFO:tasks.ceph:Copying monmap to all nodes... 2020-11-20T11:49:25.579 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:49:25.579 INFO:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T11:49:25.597 INFO:teuthology.orchestra.run.smithi164.stderr:+ dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T11:49:25.598 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.] 2020-11-20T11:49:25.598 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBFrbdfWqlbBRAA1uHBVkNKj28J1oqSJt3yxw== 2020-11-20T11:49:25.599 INFO:teuthology.orchestra.run.smithi164.stdout:[client.admin] 2020-11-20T11:49:25.599 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBFrbdfRdw9IhAAszmSDjkElWVWkU9PoWoq2g== 2020-11-20T11:49:25.599 INFO:teuthology.orchestra.run.smithi164.stdout: caps mds = "allow *" 2020-11-20T11:49:25.599 INFO:teuthology.orchestra.run.smithi164.stdout: caps mgr = "allow *" 2020-11-20T11:49:25.599 INFO:teuthology.orchestra.run.smithi164.stdout: caps mon = "allow *" 2020-11-20T11:49:25.600 INFO:teuthology.orchestra.run.smithi164.stdout: caps osd = "allow *" 2020-11-20T11:49:25.600 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:49:25.600 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:49:25.600 INFO:teuthology.orchestra.run.smithi164.stderr:206 bytes copied, 3.1351e-05 s, 6.6 MB/s 2020-11-20T11:49:25.601 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:49:25.601 INFO:teuthology.orchestra.run.smithi164:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T11:49:25.654 INFO:teuthology.orchestra.run.smithi164.stderr:+ dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T11:49:25.655 INFO:teuthology.orchestra.run.smithi164.stdout: ���v�g@v�~��sr��E��_�ȆE��_�Ȇ�aXa �����bXb �$��$cXc �����abc 2020-11-20T11:49:25.655 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:49:25.655 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:49:25.656 INFO:teuthology.orchestra.run.smithi164.stderr:409 bytes copied, 3.0479e-05 s, 13.4 MB/s 2020-11-20T11:49:25.656 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T11:49:25.656 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:49:25.657 INFO:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:49:25.657 INFO:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:49:25.712 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:49:25.721 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:49:25.722 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:49:25.723 INFO:teuthology.orchestra.run.smithi164.stderr:206 bytes copied, 4.7322e-05 s, 4.4 MB/s 2020-11-20T11:49:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:49:25.734 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:49:25.734 INFO:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:25.790 INFO:teuthology.orchestra.run.smithi164.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:25.792 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:49:25.792 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:49:25.792 INFO:teuthology.orchestra.run.smithi164.stderr:409 bytes copied, 0.00105743 s, 387 kB/s 2020-11-20T11:49:25.793 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi036.front.sepia.ceph.com 2020-11-20T11:49:25.793 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:49:25.794 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:49:25.794 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:49:25.813 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:49:25.824 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:49:25.824 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:49:25.825 INFO:teuthology.orchestra.run.smithi036.stderr:206 bytes copied, 3.7467e-05 s, 5.5 MB/s 2020-11-20T11:49:25.825 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:49:25.838 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:49:25.839 INFO:teuthology.orchestra.run.smithi036:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:25.895 INFO:teuthology.orchestra.run.smithi036.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:25.896 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:49:25.897 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:49:25.897 INFO:teuthology.orchestra.run.smithi036.stderr:409 bytes copied, 4.1688e-05 s, 9.8 MB/s 2020-11-20T11:49:25.898 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T11:49:25.898 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:49:25.898 INFO:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:49:25.899 INFO:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:49:25.915 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:49:25.927 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:49:25.927 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:49:25.927 INFO:teuthology.orchestra.run.smithi188.stderr:206 bytes copied, 3.7949e-05 s, 5.4 MB/s 2020-11-20T11:49:25.928 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:49:25.940 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:49:25.940 INFO:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:25.997 INFO:teuthology.orchestra.run.smithi188.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:26.001 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:49:26.002 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:49:26.002 INFO:teuthology.orchestra.run.smithi188.stderr:409 bytes copied, 3.0569e-05 s, 13.4 MB/s 2020-11-20T11:49:26.002 INFO:tasks.ceph:Setting up mon nodes... 2020-11-20T11:49:26.003 INFO:tasks.ceph:Setting up mgr nodes... 2020-11-20T11:49:26.003 INFO:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T11:49:26.055 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T11:49:26.057 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T11:49:26.125 INFO:teuthology.orchestra.run.smithi036.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T11:49:26.127 INFO:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T11:49:26.190 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T11:49:26.193 INFO:tasks.ceph:Setting up mds nodes... 2020-11-20T11:49:26.194 INFO:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T11:49:26.241 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T11:49:26.243 INFO:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-11-20T11:49:26.268 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T11:49:26.325 INFO:teuthology.orchestra.run.smithi036.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T11:49:26.328 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-11-20T11:49:26.356 INFO:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T11:49:26.407 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T11:49:26.410 INFO:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2020-11-20T11:49:26.435 INFO:tasks.ceph_client:Setting up client nodes... 2020-11-20T11:49:26.436 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-20T11:49:26.472 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-11-20T11:49:26.484 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-11-20T11:49:26.484 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi036.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T11:49:26.485 INFO:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-11-20T11:49:26.548 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:26.548 INFO:tasks.ceph:role: osd.0 2020-11-20T11:49:26.548 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T11:49:26.549 INFO:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:49:26.619 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:26.620 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:26.620 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:26.620 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 2020-11-20T11:49:26.620 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:26.620 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:26.621 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:26.621 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:26.621 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:26.621 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:26.979 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2020-11-20T11:49:26.981 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2020-11-20T11:49:26.981 INFO:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-11-20T11:49:27.110 INFO:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-11-20T11:49:27.140 INFO:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-11-20T11:49:27.204 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:27.205 INFO:tasks.ceph:role: osd.3 2020-11-20T11:49:27.205 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T11:49:27.205 INFO:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:49:27.275 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:27.275 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:27.275 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:27.275 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 2020-11-20T11:49:27.276 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:27.276 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:27.276 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:27.276 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:27.276 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:27.277 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:27.640 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2020-11-20T11:49:27.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2020-11-20T11:49:27.642 INFO:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2020-11-20T11:49:27.725 INFO:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-11-20T11:49:27.793 INFO:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-11-20T11:49:27.857 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:27.858 INFO:tasks.ceph:role: osd.6 2020-11-20T11:49:27.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T11:49:27.859 INFO:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:49:27.929 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:27.929 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 2020-11-20T11:49:27.930 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:27.930 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:27.931 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:27.931 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:27.931 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:27.931 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:28.299 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2020-11-20T11:49:28.301 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2020-11-20T11:49:28.301 INFO:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-11-20T11:49:28.401 INFO:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-11-20T11:49:28.428 INFO:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2020-11-20T11:49:28.492 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:28.493 INFO:tasks.ceph:role: osd.9 2020-11-20T11:49:28.493 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T11:49:28.493 INFO:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:49:28.563 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:28.564 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:28.564 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:28.564 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 2020-11-20T11:49:28.564 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:28.565 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:28.565 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:28.565 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:28.565 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:28.565 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:28.938 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2020-11-20T11:49:28.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2020-11-20T11:49:28.940 INFO:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2020-11-20T11:49:29.068 INFO:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2020-11-20T11:49:29.106 INFO:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:29.190 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:29.188+0000 7f703286ff40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-11-20T11:49:29.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:29.191+0000 7f703286ff40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-11-20T11:49:29.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:29.191+0000 7f703286ff40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:49:29.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:29.191+0000 7f703286ff40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:49:29.195 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:29.191+0000 7f703286ff40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:49:29.196 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:29.192+0000 7f703286ff40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-11-20T11:49:32.039 INFO:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-20T11:49:32.113 INFO:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:32.202 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:32.199+0000 7fa5c1604f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-11-20T11:49:32.202 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:32.199+0000 7fa5c1604f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-11-20T11:49:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:32.199+0000 7fa5c1604f40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:49:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:32.199+0000 7fa5c1604f40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:49:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:32.199+0000 7fa5c1604f40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:49:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:32.200+0000 7fa5c1604f40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-11-20T11:49:35.045 INFO:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-20T11:49:35.124 INFO:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:35.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:35.217+0000 7f913905ff40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-11-20T11:49:35.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:35.217+0000 7f913905ff40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-11-20T11:49:35.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:35.217+0000 7f913905ff40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:49:35.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:35.217+0000 7f913905ff40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:49:35.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:35.217+0000 7f913905ff40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:49:35.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:35.217+0000 7f913905ff40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-11-20T11:49:38.067 INFO:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-20T11:49:38.137 INFO:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:38.263 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:38.260+0000 7fafc8479f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2020-11-20T11:49:38.264 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:38.260+0000 7fafc8479f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2020-11-20T11:49:38.264 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:38.260+0000 7fafc8479f40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:49:38.265 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:38.260+0000 7fafc8479f40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:49:38.265 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:38.260+0000 7fafc8479f40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:49:38.266 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:49:38.260+0000 7fafc8479f40 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2020-11-20T11:49:41.108 INFO:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2020-11-20T11:49:41.138 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-11-20T11:49:41.169 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:41.170 INFO:tasks.ceph:role: osd.1 2020-11-20T11:49:41.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-20T11:49:41.170 INFO:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:49:41.245 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: = reflink=1 2020-11-20T11:49:41.246 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:41.247 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:41.247 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:41.247 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:41.247 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:41.248 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:41.609 INFO:teuthology.orchestra.run.smithi036.stdout:Discarding blocks...Done. 2020-11-20T11:49:41.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2020-11-20T11:49:41.612 INFO:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-11-20T11:49:41.737 INFO:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-11-20T11:49:41.771 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-11-20T11:49:41.838 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:41.838 INFO:tasks.ceph:role: osd.4 2020-11-20T11:49:41.838 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-20T11:49:41.839 INFO:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:49:41.912 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:41.913 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:41.914 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:41.914 INFO:teuthology.orchestra.run.smithi036.stdout: = reflink=1 2020-11-20T11:49:41.914 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:41.914 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:41.914 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:41.915 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:41.915 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:41.915 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:42.272 INFO:teuthology.orchestra.run.smithi036.stdout:Discarding blocks...Done. 2020-11-20T11:49:42.274 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2020-11-20T11:49:42.274 INFO:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2020-11-20T11:49:42.366 INFO:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-11-20T11:49:42.396 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-11-20T11:49:42.462 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:42.463 INFO:tasks.ceph:role: osd.7 2020-11-20T11:49:42.463 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-20T11:49:42.463 INFO:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:49:42.536 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: = reflink=1 2020-11-20T11:49:42.538 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:42.538 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:42.538 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:42.539 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:42.539 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:42.539 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:42.901 INFO:teuthology.orchestra.run.smithi036.stdout:Discarding blocks...Done. 2020-11-20T11:49:42.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2020-11-20T11:49:42.908 INFO:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2020-11-20T11:49:43.008 INFO:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-11-20T11:49:43.039 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2020-11-20T11:49:43.106 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:43.107 INFO:tasks.ceph:role: osd.10 2020-11-20T11:49:43.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-20T11:49:43.107 INFO:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:49:43.179 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:43.180 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:43.180 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:43.180 INFO:teuthology.orchestra.run.smithi036.stdout: = reflink=1 2020-11-20T11:49:43.181 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:43.183 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:43.183 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:43.183 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:43.184 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:43.184 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:43.554 INFO:teuthology.orchestra.run.smithi036.stdout:Discarding blocks...Done. 2020-11-20T11:49:43.556 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2020-11-20T11:49:43.556 INFO:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2020-11-20T11:49:43.707 INFO:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2020-11-20T11:49:43.748 INFO:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:43.841 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:43.838+0000 7f1357d8cf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-11-20T11:49:43.842 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:43.839+0000 7f1357d8cf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-11-20T11:49:43.842 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:43.839+0000 7f1357d8cf40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:49:43.843 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:43.839+0000 7f1357d8cf40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:49:43.843 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:43.839+0000 7f1357d8cf40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:49:43.849 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:43.846+0000 7f1357d8cf40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-11-20T11:49:46.698 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-20T11:49:46.730 INFO:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:46.820 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:46.817+0000 7f307910ef40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-11-20T11:49:46.821 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:46.818+0000 7f307910ef40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-11-20T11:49:46.821 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:46.818+0000 7f307910ef40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:49:46.821 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:46.818+0000 7f307910ef40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:49:46.821 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:46.818+0000 7f307910ef40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:49:46.822 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:46.818+0000 7f307910ef40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-11-20T11:49:49.664 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-20T11:49:49.694 INFO:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:49.779 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:49.776+0000 7fdea04fff40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-11-20T11:49:49.780 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:49.777+0000 7fdea04fff40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-11-20T11:49:49.780 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:49.777+0000 7fdea04fff40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:49:49.780 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:49.777+0000 7fdea04fff40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:49:49.780 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:49.777+0000 7fdea04fff40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:49:49.781 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:49.777+0000 7fdea04fff40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-11-20T11:49:52.624 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-20T11:49:52.668 INFO:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:52.763 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:52.759+0000 7fd64a1e7f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2020-11-20T11:49:52.763 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:52.760+0000 7fd64a1e7f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2020-11-20T11:49:52.763 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:52.760+0000 7fd64a1e7f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:49:52.763 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:52.760+0000 7fd64a1e7f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:49:52.764 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:52.760+0000 7fd64a1e7f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:49:52.764 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-20T11:49:52.760+0000 7fd64a1e7f40 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2020-11-20T11:49:53.888 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:53.898 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:53.904 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:55.613 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2020-11-20T11:49:55.643 INFO:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-11-20T11:49:55.672 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:55.673 INFO:tasks.ceph:role: osd.2 2020-11-20T11:49:55.673 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T11:49:55.674 INFO:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:49:55.747 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:55.748 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:55.748 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:55.748 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 2020-11-20T11:49:55.749 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:55.749 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:55.749 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:55.749 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:55.749 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:55.750 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:56.111 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2020-11-20T11:49:56.113 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2020-11-20T11:49:56.113 INFO:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2020-11-20T11:49:56.240 INFO:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-11-20T11:49:56.271 INFO:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-11-20T11:49:56.338 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:56.339 INFO:tasks.ceph:role: osd.5 2020-11-20T11:49:56.339 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T11:49:56.339 INFO:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:49:56.411 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 2020-11-20T11:49:56.412 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:56.412 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:56.413 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:56.413 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:56.413 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:56.413 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:56.776 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2020-11-20T11:49:56.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2020-11-20T11:49:56.778 INFO:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-11-20T11:49:56.865 INFO:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-11-20T11:49:56.895 INFO:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2020-11-20T11:49:56.960 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:56.960 INFO:tasks.ceph:role: osd.8 2020-11-20T11:49:56.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T11:49:56.961 INFO:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:49:57.031 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:57.032 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:57.032 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:57.032 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 2020-11-20T11:49:57.032 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:57.032 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:57.033 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:57.033 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:57.033 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:57.033 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:57.396 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2020-11-20T11:49:57.757 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2020-11-20T11:49:57.757 INFO:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2020-11-20T11:49:57.898 INFO:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2020-11-20T11:49:57.930 INFO:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2020-11-20T11:49:57.997 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:49:57.998 INFO:tasks.ceph:role: osd.11 2020-11-20T11:49:57.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T11:49:57.999 INFO:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:49:58.071 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:49:58.071 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:49:58.071 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:49:58.072 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 2020-11-20T11:49:58.072 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:49:58.072 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:49:58.072 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:49:58.072 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:49:58.073 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:49:58.073 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:49:58.435 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2020-11-20T11:49:58.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2020-11-20T11:49:58.437 INFO:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2020-11-20T11:49:58.572 INFO:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2020-11-20T11:49:58.616 INFO:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:49:58.711 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:49:58.708+0000 7f439ebcdf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-11-20T11:49:58.712 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:49:58.709+0000 7f439ebcdf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-11-20T11:49:58.713 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:49:58.709+0000 7f439ebcdf40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:49:58.713 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:49:58.709+0000 7f439ebcdf40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:49:58.713 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:49:58.709+0000 7f439ebcdf40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:49:58.719 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:49:58.716+0000 7f439ebcdf40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-11-20T11:50:01.571 INFO:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-11-20T11:50:01.641 INFO:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:50:01.726 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:01.723+0000 7f4442ebdf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-11-20T11:50:01.726 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:01.723+0000 7f4442ebdf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-11-20T11:50:01.727 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:01.724+0000 7f4442ebdf40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:50:01.728 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:01.724+0000 7f4442ebdf40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:50:01.728 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:01.724+0000 7f4442ebdf40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:50:01.728 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:01.724+0000 7f4442ebdf40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-11-20T11:50:04.575 INFO:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-20T11:50:04.607 INFO:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:50:04.697 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:04.693+0000 7f3ab46aef40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2020-11-20T11:50:04.697 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:04.694+0000 7f3ab46aef40 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2020-11-20T11:50:04.698 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:04.694+0000 7f3ab46aef40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:50:04.698 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:04.694+0000 7f3ab46aef40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:50:04.698 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:04.694+0000 7f3ab46aef40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:50:04.698 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:04.694+0000 7f3ab46aef40 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2020-11-20T11:50:07.539 INFO:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2020-11-20T11:50:07.568 INFO:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:50:07.654 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:07.650+0000 7f67cd8bff40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2020-11-20T11:50:07.655 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:07.650+0000 7f67cd8bff40 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2020-11-20T11:50:07.655 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:07.650+0000 7f67cd8bff40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:50:07.655 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:07.650+0000 7f67cd8bff40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:50:07.656 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:07.650+0000 7f67cd8bff40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:50:07.656 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:07.650+0000 7f67cd8bff40 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2020-11-20T11:50:10.495 INFO:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2020-11-20T11:50:10.526 INFO:tasks.ceph:Reading keys from all nodes... 2020-11-20T11:50:10.527 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:10.527 INFO:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T11:50:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T11:50:10.558 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2020-11-20T11:50:10.558 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBGrbdfPfMtAxAAE+ifDUQd6Qh2Xz6G3MI2Ow== 2020-11-20T11:50:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:56 bytes copied, 6.3787e-05 s, 878 kB/s 2020-11-20T11:50:10.560 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:10.560 INFO:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T11:50:10.624 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T11:50:10.635 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2020-11-20T11:50:10.635 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBGrbdfcqxADhAAbjmL4ad83n5dFHk1lh+z3A== 2020-11-20T11:50:10.636 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:10.636 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:10.637 INFO:teuthology.orchestra.run.smithi164.stderr:56 bytes copied, 3.96e-05 s, 1.4 MB/s 2020-11-20T11:50:10.640 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:10.640 INFO:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T11:50:10.698 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T11:50:10.708 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2020-11-20T11:50:10.709 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBJrbdfjT4/CxAAkgeoiRg8ZdTERFwqlyKs2A== 2020-11-20T11:50:10.709 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:10.709 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:10.710 INFO:teuthology.orchestra.run.smithi164.stderr:56 bytes copied, 2.9818e-05 s, 1.9 MB/s 2020-11-20T11:50:10.711 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:10.711 INFO:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T11:50:10.769 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T11:50:10.779 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2020-11-20T11:50:10.779 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBMrbdfZE/uCxAAbuJ+C1+cmJuqpSTzbKi22w== 2020-11-20T11:50:10.780 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:10.780 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:10.780 INFO:teuthology.orchestra.run.smithi164.stderr:56 bytes copied, 4.6601e-05 s, 1.2 MB/s 2020-11-20T11:50:10.781 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:10.783 INFO:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T11:50:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T11:50:10.846 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2020-11-20T11:50:10.847 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBPrbdfCTf5DBAA/AqORKjVnKVQEZ8+6kd/aw== 2020-11-20T11:50:10.847 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:10.847 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:10.848 INFO:teuthology.orchestra.run.smithi164.stderr:56 bytes copied, 3.1703e-05 s, 1.8 MB/s 2020-11-20T11:50:10.849 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:10.849 INFO:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T11:50:10.904 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T11:50:10.913 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.9] 2020-11-20T11:50:10.914 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBSrbdfudCIDxAA9+0q446Or84OUeIzhQNTTQ== 2020-11-20T11:50:10.914 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:10.914 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:10.914 INFO:teuthology.orchestra.run.smithi164.stderr:56 bytes copied, 2.6852e-05 s, 2.1 MB/s 2020-11-20T11:50:10.915 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:50:10.916 INFO:teuthology.orchestra.run.smithi036:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T11:50:10.932 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T11:50:10.947 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr.y] 2020-11-20T11:50:10.948 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBGrbdfwJJbBxAADBN5elPSqvUk/sESxHBs8A== 2020-11-20T11:50:10.948 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:50:10.949 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:50:10.950 INFO:teuthology.orchestra.run.smithi036.stderr:56 bytes copied, 4.9833e-05 s, 1.1 MB/s 2020-11-20T11:50:10.951 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:50:10.951 INFO:teuthology.orchestra.run.smithi036:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T11:50:11.006 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T11:50:11.018 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.b] 2020-11-20T11:50:11.019 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBGrbdfP5RCExAA1FSwySZN+FXJjxYWF0xx8Q== 2020-11-20T11:50:11.019 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:50:11.019 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:50:11.020 INFO:teuthology.orchestra.run.smithi036.stderr:56 bytes copied, 4.403e-05 s, 1.3 MB/s 2020-11-20T11:50:11.021 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:50:11.021 INFO:teuthology.orchestra.run.smithi036:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T11:50:11.076 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T11:50:11.087 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.1] 2020-11-20T11:50:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBXrbdfi5YNMhAA89GqH0rtA8vzqNMJ6Rlbkg== 2020-11-20T11:50:11.088 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:50:11.088 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:50:11.088 INFO:teuthology.orchestra.run.smithi036.stderr:56 bytes copied, 3.5688e-05 s, 1.6 MB/s 2020-11-20T11:50:11.089 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:50:11.090 INFO:teuthology.orchestra.run.smithi036:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T11:50:11.144 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T11:50:11.155 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.4] 2020-11-20T11:50:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBarbdfop7KMBAAQha8cZ6n4jzHMLCKVusIyg== 2020-11-20T11:50:11.157 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:50:11.157 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:50:11.157 INFO:teuthology.orchestra.run.smithi036.stderr:56 bytes copied, 5.276e-05 s, 1.1 MB/s 2020-11-20T11:50:11.158 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:50:11.158 INFO:teuthology.orchestra.run.smithi036:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T11:50:11.213 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T11:50:11.224 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.7] 2020-11-20T11:50:11.224 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBdrbdflRJZLhAAPd6lOsKmAkxdcFlXcb2r6A== 2020-11-20T11:50:11.224 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:50:11.224 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:50:11.225 INFO:teuthology.orchestra.run.smithi036.stderr:56 bytes copied, 3.5399e-05 s, 1.6 MB/s 2020-11-20T11:50:11.226 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:50:11.226 INFO:teuthology.orchestra.run.smithi036:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T11:50:11.280 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T11:50:11.290 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.10] 2020-11-20T11:50:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBgrbdfm6BXLRAA2+WhtQDeQ/vsZOxLQfyUmA== 2020-11-20T11:50:11.291 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:50:11.291 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:50:11.291 INFO:teuthology.orchestra.run.smithi036.stderr:57 bytes copied, 3.5101e-05 s, 1.6 MB/s 2020-11-20T11:50:11.292 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:50:11.292 INFO:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T11:50:11.309 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T11:50:11.320 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.z] 2020-11-20T11:50:11.321 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBGrbdfhfw9CxAAa6+SP3ymk8W3w6QuxW7zbg== 2020-11-20T11:50:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:50:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:50:11.321 INFO:teuthology.orchestra.run.smithi188.stderr:56 bytes copied, 4.2233e-05 s, 1.3 MB/s 2020-11-20T11:50:11.324 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:50:11.325 INFO:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T11:50:11.380 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T11:50:11.391 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2020-11-20T11:50:11.391 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBGrbdfypUrGBAAeJgxdpGP00BElgSnxeSTiA== 2020-11-20T11:50:11.392 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:50:11.392 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:50:11.392 INFO:teuthology.orchestra.run.smithi188.stderr:56 bytes copied, 4.012e-05 s, 1.4 MB/s 2020-11-20T11:50:11.393 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:50:11.394 INFO:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T11:50:11.447 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T11:50:11.458 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.2] 2020-11-20T11:50:11.459 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBmrbdfq/hOKhAAWA7kno1ikMGkOqh/Dauo/g== 2020-11-20T11:50:11.459 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:50:11.459 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:50:11.460 INFO:teuthology.orchestra.run.smithi188.stderr:56 bytes copied, 3.2419e-05 s, 1.7 MB/s 2020-11-20T11:50:11.461 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:50:11.461 INFO:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T11:50:11.515 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T11:50:11.525 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.5] 2020-11-20T11:50:11.525 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBprbdfyCEtKxAAAdgtNPNKub0kr8lrrusfYA== 2020-11-20T11:50:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:50:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:50:11.526 INFO:teuthology.orchestra.run.smithi188.stderr:56 bytes copied, 3.1746e-05 s, 1.8 MB/s 2020-11-20T11:50:11.527 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:50:11.527 INFO:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T11:50:11.582 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T11:50:11.592 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.8] 2020-11-20T11:50:11.592 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBsrbdf7d5qKRAAq25yZ5SCUKNXde/YVjrzTQ== 2020-11-20T11:50:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:50:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:50:11.593 INFO:teuthology.orchestra.run.smithi188.stderr:56 bytes copied, 2.9868e-05 s, 1.9 MB/s 2020-11-20T11:50:11.594 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:50:11.594 INFO:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T11:50:11.648 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T11:50:11.659 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.11] 2020-11-20T11:50:11.659 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBvrbdftEnNJhAAZWtlIBgr/GssEkxMDGi9hA== 2020-11-20T11:50:11.659 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:50:11.660 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:50:11.660 INFO:teuthology.orchestra.run.smithi188.stderr:57 bytes copied, 3.0678e-05 s, 1.9 MB/s 2020-11-20T11:50:11.661 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:11.661 INFO:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T11:50:11.676 INFO:teuthology.orchestra.run.smithi164.stderr:+ dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T11:50:11.677 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2020-11-20T11:50:11.678 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBGrbdf4MAIHBAArH1J8PRiz+OKtrzC785daw== 2020-11-20T11:50:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:59 bytes copied, 3.5372e-05 s, 1.7 MB/s 2020-11-20T11:50:11.679 INFO:tasks.ceph:Adding keys to all mons... 2020-11-20T11:50:11.679 INFO:teuthology.orchestra.run.smithi036:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:50:11.682 INFO:teuthology.orchestra.run.smithi164:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:50:11.720 INFO:teuthology.orchestra.run.smithi188:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:50:11.724 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr.x] 2020-11-20T11:50:11.724 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBGrbdfPfMtAxAAE+ifDUQd6Qh2Xz6G3MI2Ow== 2020-11-20T11:50:11.724 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.a] 2020-11-20T11:50:11.724 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBGrbdfcqxADhAAbjmL4ad83n5dFHk1lh+z3A== 2020-11-20T11:50:11.725 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.0] 2020-11-20T11:50:11.725 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBJrbdfjT4/CxAAkgeoiRg8ZdTERFwqlyKs2A== 2020-11-20T11:50:11.725 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.3] 2020-11-20T11:50:11.725 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBMrbdfZE/uCxAAbuJ+C1+cmJuqpSTzbKi22w== 2020-11-20T11:50:11.725 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.6] 2020-11-20T11:50:11.726 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBPrbdfCTf5DBAA/AqORKjVnKVQEZ8+6kd/aw== 2020-11-20T11:50:11.726 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.9] 2020-11-20T11:50:11.726 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBSrbdfudCIDxAA9+0q446Or84OUeIzhQNTTQ== 2020-11-20T11:50:11.726 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr.y] 2020-11-20T11:50:11.727 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBGrbdfwJJbBxAADBN5elPSqvUk/sESxHBs8A== 2020-11-20T11:50:11.727 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.b] 2020-11-20T11:50:11.727 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBGrbdfP5RCExAA1FSwySZN+FXJjxYWF0xx8Q== 2020-11-20T11:50:11.727 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.1] 2020-11-20T11:50:11.727 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBXrbdfi5YNMhAA89GqH0rtA8vzqNMJ6Rlbkg== 2020-11-20T11:50:11.728 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.4] 2020-11-20T11:50:11.728 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBarbdfop7KMBAAQha8cZ6n4jzHMLCKVusIyg== 2020-11-20T11:50:11.728 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.7] 2020-11-20T11:50:11.728 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBdrbdflRJZLhAAPd6lOsKmAkxdcFlXcb2r6A== 2020-11-20T11:50:11.728 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.10] 2020-11-20T11:50:11.729 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBgrbdfm6BXLRAA2+WhtQDeQ/vsZOxLQfyUmA== 2020-11-20T11:50:11.729 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr.z] 2020-11-20T11:50:11.729 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBGrbdfhfw9CxAAa6+SP3ymk8W3w6QuxW7zbg== 2020-11-20T11:50:11.729 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.c] 2020-11-20T11:50:11.729 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBGrbdfypUrGBAAeJgxdpGP00BElgSnxeSTiA== 2020-11-20T11:50:11.730 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.2] 2020-11-20T11:50:11.730 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBmrbdfq/hOKhAAWA7kno1ikMGkOqh/Dauo/g== 2020-11-20T11:50:11.730 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.5] 2020-11-20T11:50:11.730 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBprbdfyCEtKxAAAdgtNPNKub0kr8lrrusfYA== 2020-11-20T11:50:11.730 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.8] 2020-11-20T11:50:11.731 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBsrbdf7d5qKRAAq25yZ5SCUKNXde/YVjrzTQ== 2020-11-20T11:50:11.731 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.11] 2020-11-20T11:50:11.731 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBvrbdftEnNJhAAZWtlIBgr/GssEkxMDGi9hA== 2020-11-20T11:50:11.731 INFO:teuthology.orchestra.run.smithi036.stdout:[client.0] 2020-11-20T11:50:11.731 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBGrbdf4MAIHBAArH1J8PRiz+OKtrzC785daw== 2020-11-20T11:50:11.742 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2020-11-20T11:50:11.743 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBGrbdfPfMtAxAAE+ifDUQd6Qh2Xz6G3MI2Ow== 2020-11-20T11:50:11.743 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2020-11-20T11:50:11.743 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBGrbdfcqxADhAAbjmL4ad83n5dFHk1lh+z3A== 2020-11-20T11:50:11.743 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2020-11-20T11:50:11.744 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBJrbdfjT4/CxAAkgeoiRg8ZdTERFwqlyKs2A== 2020-11-20T11:50:11.744 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2020-11-20T11:50:11.744 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBMrbdfZE/uCxAAbuJ+C1+cmJuqpSTzbKi22w== 2020-11-20T11:50:11.744 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2020-11-20T11:50:11.744 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBPrbdfCTf5DBAA/AqORKjVnKVQEZ8+6kd/aw== 2020-11-20T11:50:11.745 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.9] 2020-11-20T11:50:11.745 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBSrbdfudCIDxAA9+0q446Or84OUeIzhQNTTQ== 2020-11-20T11:50:11.745 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.y] 2020-11-20T11:50:11.745 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBGrbdfwJJbBxAADBN5elPSqvUk/sESxHBs8A== 2020-11-20T11:50:11.745 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2020-11-20T11:50:11.746 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBGrbdfP5RCExAA1FSwySZN+FXJjxYWF0xx8Q== 2020-11-20T11:50:11.746 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.1] 2020-11-20T11:50:11.746 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBXrbdfi5YNMhAA89GqH0rtA8vzqNMJ6Rlbkg== 2020-11-20T11:50:11.746 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.4] 2020-11-20T11:50:11.746 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBarbdfop7KMBAAQha8cZ6n4jzHMLCKVusIyg== 2020-11-20T11:50:11.747 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.7] 2020-11-20T11:50:11.747 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBdrbdflRJZLhAAPd6lOsKmAkxdcFlXcb2r6A== 2020-11-20T11:50:11.747 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.10] 2020-11-20T11:50:11.747 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBgrbdfm6BXLRAA2+WhtQDeQ/vsZOxLQfyUmA== 2020-11-20T11:50:11.747 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.z] 2020-11-20T11:50:11.748 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBGrbdfhfw9CxAAa6+SP3ymk8W3w6QuxW7zbg== 2020-11-20T11:50:11.748 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2020-11-20T11:50:11.748 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBGrbdfypUrGBAAeJgxdpGP00BElgSnxeSTiA== 2020-11-20T11:50:11.748 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.2] 2020-11-20T11:50:11.748 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBmrbdfq/hOKhAAWA7kno1ikMGkOqh/Dauo/g== 2020-11-20T11:50:11.749 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.5] 2020-11-20T11:50:11.749 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBprbdfyCEtKxAAAdgtNPNKub0kr8lrrusfYA== 2020-11-20T11:50:11.749 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.8] 2020-11-20T11:50:11.749 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBsrbdf7d5qKRAAq25yZ5SCUKNXde/YVjrzTQ== 2020-11-20T11:50:11.749 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.11] 2020-11-20T11:50:11.750 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBvrbdftEnNJhAAZWtlIBgr/GssEkxMDGi9hA== 2020-11-20T11:50:11.750 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2020-11-20T11:50:11.750 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBGrbdf4MAIHBAArH1J8PRiz+OKtrzC785daw== 2020-11-20T11:50:11.752 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.x] 2020-11-20T11:50:11.752 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBGrbdfPfMtAxAAE+ifDUQd6Qh2Xz6G3MI2Ow== 2020-11-20T11:50:11.752 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2020-11-20T11:50:11.752 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBGrbdfcqxADhAAbjmL4ad83n5dFHk1lh+z3A== 2020-11-20T11:50:11.752 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.0] 2020-11-20T11:50:11.753 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBJrbdfjT4/CxAAkgeoiRg8ZdTERFwqlyKs2A== 2020-11-20T11:50:11.753 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.3] 2020-11-20T11:50:11.753 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBMrbdfZE/uCxAAbuJ+C1+cmJuqpSTzbKi22w== 2020-11-20T11:50:11.753 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.6] 2020-11-20T11:50:11.754 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBPrbdfCTf5DBAA/AqORKjVnKVQEZ8+6kd/aw== 2020-11-20T11:50:11.754 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.9] 2020-11-20T11:50:11.754 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBSrbdfudCIDxAA9+0q446Or84OUeIzhQNTTQ== 2020-11-20T11:50:11.754 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.y] 2020-11-20T11:50:11.754 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBGrbdfwJJbBxAADBN5elPSqvUk/sESxHBs8A== 2020-11-20T11:50:11.755 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2020-11-20T11:50:11.755 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBGrbdfP5RCExAA1FSwySZN+FXJjxYWF0xx8Q== 2020-11-20T11:50:11.755 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.1] 2020-11-20T11:50:11.755 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBXrbdfi5YNMhAA89GqH0rtA8vzqNMJ6Rlbkg== 2020-11-20T11:50:11.755 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.4] 2020-11-20T11:50:11.756 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBarbdfop7KMBAAQha8cZ6n4jzHMLCKVusIyg== 2020-11-20T11:50:11.756 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.7] 2020-11-20T11:50:11.756 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBdrbdflRJZLhAAPd6lOsKmAkxdcFlXcb2r6A== 2020-11-20T11:50:11.756 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.10] 2020-11-20T11:50:11.756 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBgrbdfm6BXLRAA2+WhtQDeQ/vsZOxLQfyUmA== 2020-11-20T11:50:11.757 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.z] 2020-11-20T11:50:11.757 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBGrbdfhfw9CxAAa6+SP3ymk8W3w6QuxW7zbg== 2020-11-20T11:50:11.757 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2020-11-20T11:50:11.757 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBGrbdfypUrGBAAeJgxdpGP00BElgSnxeSTiA== 2020-11-20T11:50:11.758 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.2] 2020-11-20T11:50:11.758 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBmrbdfq/hOKhAAWA7kno1ikMGkOqh/Dauo/g== 2020-11-20T11:50:11.758 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.5] 2020-11-20T11:50:11.758 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBprbdfyCEtKxAAAdgtNPNKub0kr8lrrusfYA== 2020-11-20T11:50:11.758 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.8] 2020-11-20T11:50:11.759 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBsrbdf7d5qKRAAq25yZ5SCUKNXde/YVjrzTQ== 2020-11-20T11:50:11.759 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.11] 2020-11-20T11:50:11.759 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBvrbdftEnNJhAAZWtlIBgr/GssEkxMDGi9hA== 2020-11-20T11:50:11.759 INFO:teuthology.orchestra.run.smithi188.stdout:[client.0] 2020-11-20T11:50:11.759 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQBGrbdf4MAIHBAArH1J8PRiz+OKtrzC785daw== 2020-11-20T11:50:11.760 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:50:11.775 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:50:11.795 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:50:11.842 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:50:11.844 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:50:11.846 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:50:11.895 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:11.898 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:11.900 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:11.944 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:11.947 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:11.949 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:11.993 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:11.996 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:11.998 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.044 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.047 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.050 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.094 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:50:12.133 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:50:12.136 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:50:12.180 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:50:12.183 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:50:12.185 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:50:12.269 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.271 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.274 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.318 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.321 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.359 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.404 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.407 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.443 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.490 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.492 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.494 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.540 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:50:12.543 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:50:12.546 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:50:12.592 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:50:12.595 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:50:12.597 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:50:12.644 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.647 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.649 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.694 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.697 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.699 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.744 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.746 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.749 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.829 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.832 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.834 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:50:12.882 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:50:12.886 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:50:12.903 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:50:12.973 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-11-20T11:50:12.974 INFO:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-11-20T11:50:13.027 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:50:13.120 INFO:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-11-20T11:50:13.147 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-11-20T11:50:13.175 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:50:13.271 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-11-20T11:50:13.298 INFO:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-11-20T11:50:13.326 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:50:13.419 INFO:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-11-20T11:50:13.443 INFO:teuthology.orchestra.run.smithi036:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:50:13.446 INFO:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:50:13.448 INFO:teuthology.orchestra.run.smithi188:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:50:13.498 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-11-20T11:50:13.499 INFO:tasks.ceph.mon.a:Restarting daemon 2020-11-20T11:50:13.500 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-11-20T11:50:13.503 INFO:tasks.ceph.mon.a:Started 2020-11-20T11:50:13.503 INFO:tasks.ceph.mon.b:Restarting daemon 2020-11-20T11:50:13.504 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-11-20T11:50:13.506 INFO:tasks.ceph.mon.b:Started 2020-11-20T11:50:13.506 INFO:tasks.ceph.mon.c:Restarting daemon 2020-11-20T11:50:13.507 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-11-20T11:50:13.540 INFO:tasks.ceph.mon.c:Started 2020-11-20T11:50:13.541 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-11-20T11:50:13.541 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-11-20T11:50:13.542 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-11-20T11:50:13.544 INFO:tasks.ceph.mgr.x:Started 2020-11-20T11:50:13.544 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-11-20T11:50:13.545 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-11-20T11:50:13.547 INFO:tasks.ceph.mgr.y:Started 2020-11-20T11:50:13.547 INFO:tasks.ceph.mgr.z:Restarting daemon 2020-11-20T11:50:13.548 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2020-11-20T11:50:13.549 INFO:tasks.ceph.mgr.z:Started 2020-11-20T11:50:13.550 INFO:tasks.ceph:Setting crush tunables to default 2020-11-20T11:50:13.550 INFO:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd crush tunables default 2020-11-20T11:50:13.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.668+0000 7f0a5759e700 1 Processor -- start 2020-11-20T11:50:13.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.668+0000 7f0a5759e700 1 -- start start 2020-11-20T11:50:13.674 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a5759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:13.674 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a5759e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:13.674 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a5759e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a58064650 con 0x7f0a58065c10 2020-11-20T11:50:13.675 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a5759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a580bf040 con 0x7f0a58065ff0 2020-11-20T11:50:13.675 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a5759e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a58064880 con 0x7f0a58157c00 2020-11-20T11:50:13.675 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a56d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:13.675 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a56d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44600/0 (socket says 172.21.15.164:44600) 2020-11-20T11:50:13.675 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 learned_addr learned my addr 172.21.15.164:0/353943041 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:13.676 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 msgr2=0x7f0a58159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:50:13.676 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 msgr2=0x7f0a58159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:13.676 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:13.676 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:50:13.676 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:13.677 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 msgr2=0x7f0a58152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:50:13.677 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 msgr2=0x7f0a58152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:13.677 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:13.677 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.670+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:50:13.874 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.871+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:13.874 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.871+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 msgr2=0x7f0a58159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:50:13.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.871+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 msgr2=0x7f0a58159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:13.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.871+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:13.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.871+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:50:13.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.871+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:13.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.871+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 msgr2=0x7f0a58152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:50:13.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.871+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 msgr2=0x7f0a58152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:13.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.871+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:13.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:13.871+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:50:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:14.272+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:14.272+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 msgr2=0x7f0a58159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:50:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:14.272+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 msgr2=0x7f0a58159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:14.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:14.272+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:14.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:14.272+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:50:14.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:14.272+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:14.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:14.272+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 msgr2=0x7f0a58152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:50:14.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:14.272+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 msgr2=0x7f0a58152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:14.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:14.272+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:14.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:14.272+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:50:15.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:15.074+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:15.741 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:15.074+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 msgr2=0x7f0a58159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:50:15.741 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:15.074+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 msgr2=0x7f0a58159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:15.741 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:15.074+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:15.741 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:15.074+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:50:15.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:15.074+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:15.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:15.074+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 msgr2=0x7f0a58152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T11:50:15.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:15.074+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 msgr2=0x7f0a58152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:15.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:15.074+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:15.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:15.074+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:50:16.675 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.670+0000 7f0a54d99700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 msgr2=0x7f0a58159ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:50:16.675 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.670+0000 7f0a54d99700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.164:3300/0 conn(0x7f0a58157c00 0x7f0a58159ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:16.676 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.670+0000 7f0a54d99700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 msgr2=0x7f0a58152c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:50:16.676 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.670+0000 7f0a54d99700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.36:3300/0 conn(0x7f0a58065ff0 0x7f0a58152c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:16.677 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.670+0000 7f0a54d99700 1 -- 172.21.15.164:0/353943041 >> v1:172.21.15.188:6789/0 conn(0x7f0a58065c10 legacy=0x7f0a581524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:16.677 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.670+0000 7f0a54d99700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:16.677 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.671+0000 7f0a54d99700 1 -- 172.21.15.164:0/353943041 --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a58064b20 con 0x7f0a3c009b80 2020-11-20T11:50:16.678 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.671+0000 7f0a54d99700 1 -- 172.21.15.164:0/353943041 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c00e9d0 con 0x7f0a3c003410 2020-11-20T11:50:16.678 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.671+0000 7f0a54d99700 1 -- 172.21.15.164:0/353943041 --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a58064880 con 0x7f0a3c007030 2020-11-20T11:50:16.679 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.671+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:16.679 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.671+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 msgr2=0x7f0a3c0094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:50:16.679 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.671+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 msgr2=0x7f0a3c0094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:16.680 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.671+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:16.680 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.671+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:50:16.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.872+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:16.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.872+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 msgr2=0x7f0a3c0094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:50:16.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.872+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 msgr2=0x7f0a3c0094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:16.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.872+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:16.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:16.872+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:50:17.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:17.273+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:17.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:17.273+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 msgr2=0x7f0a3c0094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:50:17.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:17.273+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 msgr2=0x7f0a3c0094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:17.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:17.273+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:17.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:17.273+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:50:18.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.075+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:18.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.075+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 msgr2=0x7f0a3c0094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:50:18.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.075+0000 7f0a4ffff700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 msgr2=0x7f0a3c0094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:50:18.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.075+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:50:18.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.075+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:50:18.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.838+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823057949 0 0) 0x7f0a58064b20 con 0x7f0a3c009b80 2020-11-20T11:50:18.847 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.838+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a38003280 con 0x7f0a3c009b80 2020-11-20T11:50:18.848 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920682083 0 0) 0x7f0a3c00e9d0 con 0x7f0a3c003410 2020-11-20T11:50:18.848 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a58064b20 con 0x7f0a3c003410 2020-11-20T11:50:18.849 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2492917782 0 0) 0x7f0a58064b20 con 0x7f0a3c003410 2020-11-20T11:50:18.849 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 msgr2=0x7f0a3c0094f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:50:18.850 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 --2- 172.21.15.164:0/353943041 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c007030 0x7f0a3c0094f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.850 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 >> v1:172.21.15.36:6789/0 conn(0x7f0a3c009b80 legacy=0x7f0a3c00c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:18.851 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 reap_dead start 2020-11-20T11:50:18.851 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c00fcb0 con 0x7f0a3c003410 2020-11-20T11:50:18.852 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7f0a48001560 con 0x7f0a3c003410 2020-11-20T11:50:18.852 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 >> v1:172.21.15.164:6789/0 conn(0x7f0a3c003410 legacy=0x7f0a3c005820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:18.853 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38003900 0x7f0a38003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:18.853 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38004520 0x7f0a380049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:18.854 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 0x7f0a3800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:18.855 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58064880 con 0x7f0a38003900 2020-11-20T11:50:18.856 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3800bc60 con 0x7f0a38004520 2020-11-20T11:50:18.857 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.839+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3800be20 con 0x7f0a38004e90 2020-11-20T11:50:18.857 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.840+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 0x7f0a3800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:18.858 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.840+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38004520 0x7f0a380049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:18.858 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.840+0000 7f0a5659c700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38003900 0x7f0a38003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:18.859 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.840+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38004520 msgr2=0x7f0a380049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:18.859 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.840+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38004520 0x7f0a380049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.860 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.840+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38003900 msgr2=0x7f0a38003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:18.861 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.840+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38003900 0x7f0a38003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.861 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.840+0000 7f0a56d9d700 1 -- 172.21.15.164:0/353943041 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58064b20 con 0x7f0a38004e90 2020-11-20T11:50:18.862 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.840+0000 7f0a5659c700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38003900 0x7f0a38003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:18.862 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.840+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 0x7f0a3800b770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0a580623d0 tx=0x7f0a50008040).ready entity=mon.2 client_cookie=53c49ebf54133e61 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:18.863 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.841+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50002e70 con 0x7f0a38004e90 2020-11-20T11:50:18.863 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.841+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a500025e0 con 0x7f0a38004e90 2020-11-20T11:50:18.864 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.841+0000 7f0a55d9b700 1 -- 172.21.15.164:0/353943041 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50013ea0 con 0x7f0a38004e90 2020-11-20T11:50:18.864 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.841+0000 7f0a5759e700 1 -- 172.21.15.164:0/353943041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 msgr2=0x7f0a3800b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:18.865 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.841+0000 7f0a5759e700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 0x7f0a3800b770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0a580623d0 tx=0x7f0a50008040).stop 2020-11-20T11:50:18.865 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.842+0000 7f0a5759e700 1 -- 172.21.15.164:0/353943041 shutdown_connections 2020-11-20T11:50:18.865 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.842+0000 7f0a5759e700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 0x7f0a3800b770 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.866 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.842+0000 7f0a5759e700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38003900 0x7f0a38003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.866 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.842+0000 7f0a5759e700 1 --2- 172.21.15.164:0/353943041 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38004520 0x7f0a380049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.866 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.842+0000 7f0a5759e700 1 -- 172.21.15.164:0/353943041 >> 172.21.15.164:0/353943041 conn(0x7f0a580ba960 msgr2=0x7f0a5805bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:18.867 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.842+0000 7f0a5759e700 1 -- 172.21.15.164:0/353943041 shutdown_connections 2020-11-20T11:50:18.867 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.842+0000 7f0a5759e700 1 -- 172.21.15.164:0/353943041 wait complete. 2020-11-20T11:50:18.868 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.843+0000 7f0a5759e700 1 Processor -- start 2020-11-20T11:50:18.869 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.843+0000 7f0a5759e700 1 -- start start 2020-11-20T11:50:18.874 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a5759e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38003900 0x7f0a5814a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:18.874 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a5759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38004520 0x7f0a580c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:18.874 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a5759e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 0x7f0a580c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:18.874 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a5759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58147510 con 0x7f0a38004520 2020-11-20T11:50:18.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a5759e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58146a90 con 0x7f0a38003900 2020-11-20T11:50:18.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a5759e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58146d30 con 0x7f0a38004e90 2020-11-20T11:50:18.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a5659c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38003900 0x7f0a5814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:18.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a5659c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38003900 0x7f0a5814a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44672/0 (socket says 172.21.15.164:44672) 2020-11-20T11:50:18.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a5659c700 1 -- 172.21.15.164:0/572688559 learned_addr learned my addr 172.21.15.164:0/572688559 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:18.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/572688559 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38004520 0x7f0a580c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:18.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.844+0000 7f0a56d9d700 1 --2- 172.21.15.164:0/572688559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 0x7f0a580c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:18.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.845+0000 7f0a5659c700 1 -- 172.21.15.164:0/572688559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 msgr2=0x7f0a580c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:18.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.845+0000 7f0a5659c700 1 --2- 172.21.15.164:0/572688559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 0x7f0a580c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.845+0000 7f0a5659c700 1 -- 172.21.15.164:0/572688559 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38004520 msgr2=0x7f0a580c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:18.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.845+0000 7f0a5659c700 1 --2- 172.21.15.164:0/572688559 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38004520 0x7f0a580c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.845+0000 7f0a5659c700 1 -- 172.21.15.164:0/572688559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58146fd0 con 0x7f0a38003900 2020-11-20T11:50:18.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.845+0000 7f0a4ffff700 1 --2- 172.21.15.164:0/572688559 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38004520 0x7f0a580c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:18.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.845+0000 7f0a5659c700 1 --2- 172.21.15.164:0/572688559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38003900 0x7f0a5814a750 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0a4800d370 tx=0x7f0a48007740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:18.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.845+0000 7f0a4e7fc700 1 -- 172.21.15.164:0/572688559 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48009040 con 0x7f0a38003900 2020-11-20T11:50:18.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.846+0000 7f0a4e7fc700 1 -- 172.21.15.164:0/572688559 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a48001a20 con 0x7f0a38003900 2020-11-20T11:50:18.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.846+0000 7f0a4e7fc700 1 -- 172.21.15.164:0/572688559 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800dee0 con 0x7f0a38003900 2020-11-20T11:50:18.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.846+0000 7f0a5759e700 1 -- 172.21.15.164:0/572688559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a58147270 con 0x7f0a38003900 2020-11-20T11:50:18.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.846+0000 7f0a5759e700 1 -- 172.21.15.164:0/572688559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a581466e0 con 0x7f0a38003900 2020-11-20T11:50:18.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.846+0000 7f0a4e7fc700 1 -- 172.21.15.164:0/572688559 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f0a48003330 con 0x7f0a38003900 2020-11-20T11:50:18.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.846+0000 7f0a4e7fc700 1 -- 172.21.15.164:0/572688559 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0a480127b0 con 0x7f0a38003900 2020-11-20T11:50:18.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.847+0000 7f0a5759e700 1 -- 172.21.15.164:0/572688559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a58163720 con 0x7f0a38003900 2020-11-20T11:50:18.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.849+0000 7f0a4e7fc700 1 -- 172.21.15.164:0/572688559 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f0a48003810 con 0x7f0a38003900 2020-11-20T11:50:18.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.923+0000 7f0a5759e700 1 -- 172.21.15.164:0/572688559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0a58044fa0 con 0x7f0a38003900 2020-11-20T11:50:18.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.931+0000 7f0a4e7fc700 1 -- 172.21.15.164:0/572688559 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0a48029090 con 0x7f0a38003900 2020-11-20T11:50:18.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.932+0000 7f0a5759e700 1 -- 172.21.15.164:0/572688559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38003900 msgr2=0x7f0a5814a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:18.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.932+0000 7f0a5759e700 1 --2- 172.21.15.164:0/572688559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38003900 0x7f0a5814a750 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0a4800d370 tx=0x7f0a48007740).stop 2020-11-20T11:50:18.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.932+0000 7f0a5759e700 1 -- 172.21.15.164:0/572688559 shutdown_connections 2020-11-20T11:50:18.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.932+0000 7f0a5759e700 1 --2- 172.21.15.164:0/572688559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a38003900 0x7f0a5814a750 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.932+0000 7f0a5759e700 1 --2- 172.21.15.164:0/572688559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a38004e90 0x7f0a580c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.932+0000 7f0a5759e700 1 --2- 172.21.15.164:0/572688559 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0a38004520 0x7f0a580c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:18.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.932+0000 7f0a5759e700 1 -- 172.21.15.164:0/572688559 >> 172.21.15.164:0/572688559 conn(0x7f0a580ba960 msgr2=0x7f0a580c0050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:18.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.932+0000 7f0a5759e700 1 -- 172.21.15.164:0/572688559 shutdown_connections 2020-11-20T11:50:18.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:18.932+0000 7f0a5759e700 1 -- 172.21.15.164:0/572688559 wait complete. 2020-11-20T11:50:18.937 INFO:teuthology.orchestra.run.smithi164.stderr:adjusted tunables profile to default 2020-11-20T11:50:18.947 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-11-20T11:50:18.948 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:18.949 INFO:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T11:50:18.968 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T11:50:18.979 INFO:teuthology.orchestra.run.smithi164.stdout:050edf6c-5162-4282-aee5-16d0ec6a7b17 2020-11-20T11:50:18.979 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:18.979 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:18.980 INFO:teuthology.orchestra.run.smithi164.stderr:37 bytes copied, 4.7359e-05 s, 781 kB/s 2020-11-20T11:50:18.981 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:18.982 INFO:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T11:50:19.042 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T11:50:19.052 INFO:teuthology.orchestra.run.smithi164.stdout:4891bc60-773c-4fdf-991a-608f802e782f 2020-11-20T11:50:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:37 bytes copied, 4.9827e-05 s, 743 kB/s 2020-11-20T11:50:19.053 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:19.054 INFO:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T11:50:19.112 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T11:50:19.121 INFO:teuthology.orchestra.run.smithi164.stdout:84225f1e-f6bb-4587-994b-0db5e9c2412e 2020-11-20T11:50:19.121 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:19.122 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:19.122 INFO:teuthology.orchestra.run.smithi164.stderr:37 bytes copied, 4.7483e-05 s, 779 kB/s 2020-11-20T11:50:19.123 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:50:19.123 INFO:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T11:50:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T11:50:19.191 INFO:teuthology.orchestra.run.smithi164.stdout:fdb23d21-88fe-4715-8197-4fe0bded6bb4 2020-11-20T11:50:19.192 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2020-11-20T11:50:19.192 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2020-11-20T11:50:19.192 INFO:teuthology.orchestra.run.smithi164.stderr:37 bytes copied, 5.0725e-05 s, 729 kB/s 2020-11-20T11:50:19.194 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:50:19.194 INFO:teuthology.orchestra.run.smithi036:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T11:50:19.209 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T11:50:19.220 INFO:teuthology.orchestra.run.smithi036.stdout:c831cefc-812f-458c-af07-085f0dd85a31 2020-11-20T11:50:19.220 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:50:19.220 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:50:19.220 INFO:teuthology.orchestra.run.smithi036.stderr:37 bytes copied, 3.816e-05 s, 970 kB/s 2020-11-20T11:50:19.221 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:50:19.222 INFO:teuthology.orchestra.run.smithi036:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T11:50:19.276 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T11:50:19.286 INFO:teuthology.orchestra.run.smithi036.stdout:2d95ba05-a3a3-443a-8653-cfdad980c161 2020-11-20T11:50:19.287 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:50:19.287 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:50:19.287 INFO:teuthology.orchestra.run.smithi036.stderr:37 bytes copied, 3.5673e-05 s, 1.0 MB/s 2020-11-20T11:50:19.288 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:50:19.289 INFO:teuthology.orchestra.run.smithi036:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T11:50:19.342 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T11:50:19.352 INFO:teuthology.orchestra.run.smithi036.stdout:3bbb4a5c-84fe-4339-8b91-a3a26712c5c2 2020-11-20T11:50:19.352 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:50:19.353 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:50:19.353 INFO:teuthology.orchestra.run.smithi036.stderr:37 bytes copied, 3.6771e-05 s, 1.0 MB/s 2020-11-20T11:50:19.354 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-20T11:50:19.354 INFO:teuthology.orchestra.run.smithi036:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T11:50:19.408 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T11:50:19.418 INFO:teuthology.orchestra.run.smithi036.stdout:106c212d-2332-4f3a-86d6-212b125e24ac 2020-11-20T11:50:19.418 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-20T11:50:19.419 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-20T11:50:19.419 INFO:teuthology.orchestra.run.smithi036.stderr:37 bytes copied, 3.6651e-05 s, 1.0 MB/s 2020-11-20T11:50:19.420 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:50:19.420 INFO:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T11:50:19.433 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T11:50:19.443 INFO:teuthology.orchestra.run.smithi188.stdout:8478d740-989b-4d1a-8e40-6dff71e4b289 2020-11-20T11:50:19.443 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:50:19.444 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:50:19.444 INFO:teuthology.orchestra.run.smithi188.stderr:37 bytes copied, 3.7078e-05 s, 998 kB/s 2020-11-20T11:50:19.445 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:50:19.445 INFO:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T11:50:19.498 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T11:50:19.507 INFO:teuthology.orchestra.run.smithi188.stdout:f5e0530b-a407-45a4-8cc4-2ec32b722510 2020-11-20T11:50:19.508 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:50:19.508 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:50:19.508 INFO:teuthology.orchestra.run.smithi188.stderr:37 bytes copied, 3.5261e-05 s, 1.0 MB/s 2020-11-20T11:50:19.509 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:50:19.510 INFO:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T11:50:19.563 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T11:50:19.573 INFO:teuthology.orchestra.run.smithi188.stdout:ca3bb3e9-1e26-4577-8028-e1088664758d 2020-11-20T11:50:19.574 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:50:19.574 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:50:19.574 INFO:teuthology.orchestra.run.smithi188.stderr:37 bytes copied, 3.5355e-05 s, 1.0 MB/s 2020-11-20T11:50:19.575 INFO:teuthology.orchestra.run.smithi188:> set -ex 2020-11-20T11:50:19.576 INFO:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T11:50:19.631 INFO:teuthology.orchestra.run.smithi188.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T11:50:19.642 INFO:teuthology.orchestra.run.smithi188.stdout:428273c5-731b-4472-98e6-62b48a587419 2020-11-20T11:50:19.643 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2020-11-20T11:50:19.643 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2020-11-20T11:50:19.643 INFO:teuthology.orchestra.run.smithi188.stderr:37 bytes copied, 3.4027e-05 s, 1.1 MB/s 2020-11-20T11:50:19.644 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 050edf6c-5162-4282-aee5-16d0ec6a7b17 0 2020-11-20T11:50:19.804 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.800+0000 7fe771915700 1 Processor -- start 2020-11-20T11:50:19.804 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.800+0000 7fe771915700 1 -- start start 2020-11-20T11:50:19.806 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe771915700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe76c0c4470 0x7fe76c0c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:19.807 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe771915700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe76c0bf680 0x7fe76c0bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:19.807 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe771915700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c1555a0 con 0x7fe76c0bccf0 2020-11-20T11:50:19.808 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe771915700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c0c0000 con 0x7fe76c0c4470 2020-11-20T11:50:19.808 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe771915700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c1517d0 con 0x7fe76c0bf680 2020-11-20T11:50:19.808 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe76b7fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe76c0bf680 0x7fe76c0bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:19.808 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe76b7fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe76c0bf680 0x7fe76c0bfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43818/0 (socket says 172.21.15.188:43818) 2020-11-20T11:50:19.809 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe76b7fe700 1 -- 172.21.15.188:0/1989850511 learned_addr learned my addr 172.21.15.188:0/1989850511 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:19.809 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe76affd700 1 --2- 172.21.15.188:0/1989850511 >> v2:172.21.15.164:3300/0 conn(0x7fe76c0c4470 0x7fe76c0c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:19.809 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe76b7fe700 1 -- 172.21.15.188:0/1989850511 >> v2:172.21.15.164:3300/0 conn(0x7fe76c0c4470 msgr2=0x7fe76c0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:19.809 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe76b7fe700 1 --2- 172.21.15.188:0/1989850511 >> v2:172.21.15.164:3300/0 conn(0x7fe76c0c4470 0x7fe76c0c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:19.810 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe76b7fe700 1 -- 172.21.15.188:0/1989850511 >> v1:172.21.15.36:6789/0 conn(0x7fe76c0bccf0 legacy=0x7fe76c0c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:19.810 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe76b7fe700 1 -- 172.21.15.188:0/1989850511 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c151a70 con 0x7fe76c0bf680 2020-11-20T11:50:19.810 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe76b7fe700 1 --2- 172.21.15.188:0/1989850511 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0bf680 0x7fe76c0bfb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fe76c0c51c0 tx=0x7fe7640092d0).ready entity=mon.2 client_cookie=cef407413243c08f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:19.810 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe769ffb700 1 -- 172.21.15.188:0/1989850511 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76400bc80 con 0x7fe76c0bf680 2020-11-20T11:50:19.810 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe769ffb700 1 -- 172.21.15.188:0/1989850511 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76400bde0 con 0x7fe76c0bf680 2020-11-20T11:50:19.811 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.801+0000 7fe769ffb700 1 -- 172.21.15.188:0/1989850511 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764011610 con 0x7fe76c0bf680 2020-11-20T11:50:19.811 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.802+0000 7fe771915700 1 -- 172.21.15.188:0/1989850511 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0bf680 msgr2=0x7fe76c0bfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:19.811 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.802+0000 7fe771915700 1 --2- 172.21.15.188:0/1989850511 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0bf680 0x7fe76c0bfb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fe76c0c51c0 tx=0x7fe7640092d0).stop 2020-11-20T11:50:19.811 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.802+0000 7fe771915700 1 -- 172.21.15.188:0/1989850511 shutdown_connections 2020-11-20T11:50:19.812 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.802+0000 7fe771915700 1 --2- 172.21.15.188:0/1989850511 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0bf680 0x7fe76c0bfb10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:19.812 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.802+0000 7fe771915700 1 --2- 172.21.15.188:0/1989850511 >> v2:172.21.15.164:3300/0 conn(0x7fe76c0c4470 0x7fe76c0c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:19.812 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.802+0000 7fe771915700 1 -- 172.21.15.188:0/1989850511 >> 172.21.15.188:0/1989850511 conn(0x7fe76c0683b0 msgr2=0x7fe76c061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:19.812 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.802+0000 7fe771915700 1 -- 172.21.15.188:0/1989850511 shutdown_connections 2020-11-20T11:50:19.812 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.802+0000 7fe771915700 1 -- 172.21.15.188:0/1989850511 wait complete. 2020-11-20T11:50:19.815 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.803+0000 7fe771915700 1 Processor -- start 2020-11-20T11:50:19.815 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.803+0000 7fe771915700 1 -- start start 2020-11-20T11:50:19.815 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe771915700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe76c0bccf0 0x7fe76c158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:19.815 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe771915700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe76c0bf680 0x7fe76c150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:19.816 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe771915700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0c4470 0x7fe76c1122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:19.816 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe771915700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c152a50 con 0x7fe76c0bccf0 2020-11-20T11:50:19.816 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe771915700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c158740 con 0x7fe76c0bf680 2020-11-20T11:50:19.816 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe771915700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c1601c0 con 0x7fe76c0c4470 2020-11-20T11:50:19.817 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76b7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0c4470 0x7fe76c1122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:19.817 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76b7fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0c4470 0x7fe76c1122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43824/0 (socket says 172.21.15.188:43824) 2020-11-20T11:50:19.818 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76b7fe700 1 -- 172.21.15.188:0/2041128618 learned_addr learned my addr 172.21.15.188:0/2041128618 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:19.818 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76affd700 1 --2- 172.21.15.188:0/2041128618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe76c0bccf0 0x7fe76c158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:19.818 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76a7fc700 1 --2- 172.21.15.188:0/2041128618 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe76c0bf680 0x7fe76c150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:19.819 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76b7fe700 1 -- 172.21.15.188:0/2041128618 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe76c0bf680 msgr2=0x7fe76c150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:19.819 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76b7fe700 1 --2- 172.21.15.188:0/2041128618 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe76c0bf680 0x7fe76c150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:19.819 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76b7fe700 1 -- 172.21.15.188:0/2041128618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe76c0bccf0 msgr2=0x7fe76c158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:19.819 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76b7fe700 1 --2- 172.21.15.188:0/2041128618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe76c0bccf0 0x7fe76c158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:19.819 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76b7fe700 1 -- 172.21.15.188:0/2041128618 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c160460 con 0x7fe76c0c4470 2020-11-20T11:50:19.820 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76a7fc700 1 --2- 172.21.15.188:0/2041128618 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe76c0bf680 0x7fe76c150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:19.820 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe76b7fe700 1 --2- 172.21.15.188:0/2041128618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0c4470 0x7fe76c1122e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fe76c151910 tx=0x7fe764016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:19.820 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.804+0000 7fe752ffd700 1 -- 172.21.15.188:0/2041128618 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76401b6b0 con 0x7fe76c0c4470 2020-11-20T11:50:19.820 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.805+0000 7fe752ffd700 1 -- 172.21.15.188:0/2041128618 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76401b810 con 0x7fe76c0c4470 2020-11-20T11:50:19.820 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.805+0000 7fe771915700 1 -- 172.21.15.188:0/2041128618 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c160700 con 0x7fe76c0c4470 2020-11-20T11:50:19.821 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.805+0000 7fe752ffd700 1 -- 172.21.15.188:0/2041128618 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76401bb90 con 0x7fe76c0c4470 2020-11-20T11:50:19.821 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.805+0000 7fe771915700 1 -- 172.21.15.188:0/2041128618 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c160c40 con 0x7fe76c0c4470 2020-11-20T11:50:19.821 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.805+0000 7fe752ffd700 1 -- 172.21.15.188:0/2041128618 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fe764017070 con 0x7fe76c0c4470 2020-11-20T11:50:19.821 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.805+0000 7fe752ffd700 1 -- 172.21.15.188:0/2041128618 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fe7640267d0 con 0x7fe76c0c4470 2020-11-20T11:50:19.821 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.805+0000 7fe771915700 1 -- 172.21.15.188:0/2041128618 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76c069b70 con 0x7fe76c0c4470 2020-11-20T11:50:19.822 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.808+0000 7fe752ffd700 1 -- 172.21.15.188:0/2041128618 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fe764015020 con 0x7fe76c0c4470 2020-11-20T11:50:19.891 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.887+0000 7fe771915700 1 -- 172.21.15.188:0/2041128618 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "050edf6c-5162-4282-aee5-16d0ec6a7b17", "id": 0} v 0) v1 -- 0x7fe76c05d590 con 0x7fe76c0c4470 2020-11-20T11:50:19.898 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.894+0000 7fe752ffd700 1 -- 172.21.15.188:0/2041128618 <== mon.2 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "050edf6c-5162-4282-aee5-16d0ec6a7b17", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe76401c860 con 0x7fe76c0c4470 2020-11-20T11:50:19.899 INFO:teuthology.orchestra.run.smithi188.stdout:0 2020-11-20T11:50:19.900 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.895+0000 7fe771915700 1 -- 172.21.15.188:0/2041128618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0c4470 msgr2=0x7fe76c1122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:19.900 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.895+0000 7fe771915700 1 --2- 172.21.15.188:0/2041128618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0c4470 0x7fe76c1122e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fe76c151910 tx=0x7fe764016000).stop 2020-11-20T11:50:19.901 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.896+0000 7fe771915700 1 -- 172.21.15.188:0/2041128618 shutdown_connections 2020-11-20T11:50:19.901 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.896+0000 7fe771915700 1 --2- 172.21.15.188:0/2041128618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe76c0c4470 0x7fe76c1122e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:19.901 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.896+0000 7fe771915700 1 --2- 172.21.15.188:0/2041128618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe76c0bccf0 0x7fe76c158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:19.901 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.896+0000 7fe771915700 1 --2- 172.21.15.188:0/2041128618 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe76c0bf680 0x7fe76c150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:19.902 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.896+0000 7fe771915700 1 -- 172.21.15.188:0/2041128618 >> 172.21.15.188:0/2041128618 conn(0x7fe76c0683b0 msgr2=0x7fe76c14e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:19.902 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.896+0000 7fe771915700 1 -- 172.21.15.188:0/2041128618 shutdown_connections 2020-11-20T11:50:19.902 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:19.896+0000 7fe771915700 1 -- 172.21.15.188:0/2041128618 wait complete. 2020-11-20T11:50:19.914 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new c831cefc-812f-458c-af07-085f0dd85a31 1 2020-11-20T11:50:20.062 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.048+0000 7f9cfc15f700 1 Processor -- start 2020-11-20T11:50:20.062 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.048+0000 7f9cfc15f700 1 -- start start 2020-11-20T11:50:20.063 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.049+0000 7f9cfc15f700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9cf40c0740 0x7f9cf40c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.063 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.049+0000 7f9cfc15f700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9cf4151560 0x7f9cf414c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.063 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.049+0000 7f9cfc15f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf40601b0 con 0x7f9cf40be660 2020-11-20T11:50:20.063 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.049+0000 7f9cfc15f700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf40bead0 con 0x7f9cf40c0740 2020-11-20T11:50:20.063 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.049+0000 7f9cfc15f700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf414de00 con 0x7f9cf4151560 2020-11-20T11:50:20.064 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.049+0000 7f9cfa6fc700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9cf4151560 0x7f9cf414c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.064 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.049+0000 7f9cfa6fc700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9cf4151560 0x7f9cf414c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43830/0 (socket says 172.21.15.188:43830) 2020-11-20T11:50:20.064 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.049+0000 7f9cfa6fc700 1 -- 172.21.15.188:0/617215337 learned_addr learned my addr 172.21.15.188:0/617215337 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:20.064 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.049+0000 7f9cf9efb700 1 --2- 172.21.15.188:0/617215337 >> v2:172.21.15.164:3300/0 conn(0x7f9cf40c0740 0x7f9cf40c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.065 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfa6fc700 1 -- 172.21.15.188:0/617215337 >> v2:172.21.15.164:3300/0 conn(0x7f9cf40c0740 msgr2=0x7f9cf40c0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:20.065 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfa6fc700 1 --2- 172.21.15.188:0/617215337 >> v2:172.21.15.164:3300/0 conn(0x7f9cf40c0740 0x7f9cf40c0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.065 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfa6fc700 1 -- 172.21.15.188:0/617215337 >> v1:172.21.15.164:6789/0 conn(0x7f9cf40be660 legacy=0x7f9cf4060b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.065 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfa6fc700 1 -- 172.21.15.188:0/617215337 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf414e0a0 con 0x7f9cf4151560 2020-11-20T11:50:20.065 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfa6fc700 1 --2- 172.21.15.188:0/617215337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf4151560 0x7f9cf414c960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f9cf4066fb0 tx=0x7f9cec0092d0).ready entity=mon.2 client_cookie=88e11051bc6ac401 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:20.066 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cf8ef9700 1 -- 172.21.15.188:0/617215337 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00bbf0 con 0x7f9cf4151560 2020-11-20T11:50:20.066 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cf8ef9700 1 -- 172.21.15.188:0/617215337 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec00bd50 con 0x7f9cf4151560 2020-11-20T11:50:20.066 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cf8ef9700 1 -- 172.21.15.188:0/617215337 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec011610 con 0x7f9cf4151560 2020-11-20T11:50:20.066 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfc15f700 1 -- 172.21.15.188:0/617215337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf4151560 msgr2=0x7f9cf414c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.066 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfc15f700 1 --2- 172.21.15.188:0/617215337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf4151560 0x7f9cf414c960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f9cf4066fb0 tx=0x7f9cec0092d0).stop 2020-11-20T11:50:20.067 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfc15f700 1 -- 172.21.15.188:0/617215337 shutdown_connections 2020-11-20T11:50:20.067 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfc15f700 1 --2- 172.21.15.188:0/617215337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf4151560 0x7f9cf414c960 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.067 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfc15f700 1 --2- 172.21.15.188:0/617215337 >> v2:172.21.15.164:3300/0 conn(0x7f9cf40c0740 0x7f9cf40c0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.067 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.050+0000 7f9cfc15f700 1 -- 172.21.15.188:0/617215337 >> 172.21.15.188:0/617215337 conn(0x7f9cf4067130 msgr2=0x7f9cf4062d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:20.068 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.051+0000 7f9cfc15f700 1 -- 172.21.15.188:0/617215337 shutdown_connections 2020-11-20T11:50:20.068 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.051+0000 7f9cfc15f700 1 -- 172.21.15.188:0/617215337 wait complete. 2020-11-20T11:50:20.068 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.052+0000 7f9cfc15f700 1 Processor -- start 2020-11-20T11:50:20.068 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.052+0000 7f9cfc15f700 1 -- start start 2020-11-20T11:50:20.068 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.052+0000 7f9cfc15f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cf40be660 0x7f9cf4160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.069 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.052+0000 7f9cfc15f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf40c0740 0x7f9cf414edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.069 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.052+0000 7f9cfc15f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cf4151560 0x7f9cf414ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.070 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.052+0000 7f9cfc15f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf4160150 con 0x7f9cf40be660 2020-11-20T11:50:20.070 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.052+0000 7f9cfc15f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf414f5a0 con 0x7f9cf4151560 2020-11-20T11:50:20.070 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.052+0000 7f9cfc15f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf414f840 con 0x7f9cf40c0740 2020-11-20T11:50:20.070 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf96fa700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf40c0740 0x7f9cf414edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.070 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf96fa700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf40c0740 0x7f9cf414edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43836/0 (socket says 172.21.15.188:43836) 2020-11-20T11:50:20.071 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf96fa700 1 -- 172.21.15.188:0/667405818 learned_addr learned my addr 172.21.15.188:0/667405818 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:20.071 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cfa6fc700 1 --2- 172.21.15.188:0/667405818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cf4151560 0x7f9cf414ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.071 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf9efb700 1 --2- 172.21.15.188:0/667405818 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cf40be660 0x7f9cf4160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.071 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf96fa700 1 -- 172.21.15.188:0/667405818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cf4151560 msgr2=0x7f9cf414ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.072 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf96fa700 1 --2- 172.21.15.188:0/667405818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cf4151560 0x7f9cf414ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.072 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf96fa700 1 -- 172.21.15.188:0/667405818 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cf40be660 msgr2=0x7f9cf4160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.072 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf96fa700 1 --2- 172.21.15.188:0/667405818 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cf40be660 0x7f9cf4160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.072 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf96fa700 1 -- 172.21.15.188:0/667405818 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf41603b0 con 0x7f9cf40c0740 2020-11-20T11:50:20.072 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf9efb700 1 --2- 172.21.15.188:0/667405818 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cf40be660 0x7f9cf4160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:20.073 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cf96fa700 1 --2- 172.21.15.188:0/667405818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf40c0740 0x7f9cf414edc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f9cf000c710 tx=0x7f9cf0007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:20.073 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9ce1ffb700 1 -- 172.21.15.188:0/667405818 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000e4a0 con 0x7f9cf40c0740 2020-11-20T11:50:20.073 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9ce1ffb700 1 -- 172.21.15.188:0/667405818 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf0001e90 con 0x7f9cf40c0740 2020-11-20T11:50:20.073 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cfc15f700 1 -- 172.21.15.188:0/667405818 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf4160650 con 0x7f9cf40c0740 2020-11-20T11:50:20.073 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9ce1ffb700 1 -- 172.21.15.188:0/667405818 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000e830 con 0x7f9cf40c0740 2020-11-20T11:50:20.074 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9ce1ffb700 1 -- 172.21.15.188:0/667405818 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f9cf0010030 con 0x7f9cf40c0740 2020-11-20T11:50:20.074 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9cfc15f700 1 -- 172.21.15.188:0/667405818 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf414f2b0 con 0x7f9cf40c0740 2020-11-20T11:50:20.074 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.053+0000 7f9ce1ffb700 1 -- 172.21.15.188:0/667405818 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f9cf0013410 con 0x7f9cf40c0740 2020-11-20T11:50:20.074 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.054+0000 7f9cfc15f700 1 -- 172.21.15.188:0/667405818 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf41607e0 con 0x7f9cf40c0740 2020-11-20T11:50:20.074 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.058+0000 7f9ce1ffb700 1 -- 172.21.15.188:0/667405818 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f9cf00138c0 con 0x7f9cf40c0740 2020-11-20T11:50:20.139 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.135+0000 7f9cfc15f700 1 -- 172.21.15.188:0/667405818 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c831cefc-812f-458c-af07-085f0dd85a31", "id": 1} v 0) v1 -- 0x7f9cf4069b70 con 0x7f9cf40c0740 2020-11-20T11:50:20.146 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.142+0000 7f9ce1ffb700 1 -- 172.21.15.188:0/667405818 <== mon.2 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c831cefc-812f-458c-af07-085f0dd85a31", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9cf0013a60 con 0x7f9cf40c0740 2020-11-20T11:50:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:1 2020-11-20T11:50:20.148 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.143+0000 7f9cfc15f700 1 -- 172.21.15.188:0/667405818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf40c0740 msgr2=0x7f9cf414edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.148 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.143+0000 7f9cfc15f700 1 --2- 172.21.15.188:0/667405818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf40c0740 0x7f9cf414edc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f9cf000c710 tx=0x7f9cf0007c40).stop 2020-11-20T11:50:20.148 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.143+0000 7f9cfc15f700 1 -- 172.21.15.188:0/667405818 shutdown_connections 2020-11-20T11:50:20.148 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.143+0000 7f9cfc15f700 1 --2- 172.21.15.188:0/667405818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cf4151560 0x7f9cf414ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.149 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.143+0000 7f9cfc15f700 1 --2- 172.21.15.188:0/667405818 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cf40be660 0x7f9cf4160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.149 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.143+0000 7f9cfc15f700 1 --2- 172.21.15.188:0/667405818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9cf40c0740 0x7f9cf414edc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.149 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.143+0000 7f9cfc15f700 1 -- 172.21.15.188:0/667405818 >> 172.21.15.188:0/667405818 conn(0x7f9cf4067130 msgr2=0x7f9cf4148ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:20.149 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.143+0000 7f9cfc15f700 1 -- 172.21.15.188:0/667405818 shutdown_connections 2020-11-20T11:50:20.150 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.143+0000 7f9cfc15f700 1 -- 172.21.15.188:0/667405818 wait complete. 2020-11-20T11:50:20.159 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 8478d740-989b-4d1a-8e40-6dff71e4b289 2 2020-11-20T11:50:20.270 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.266+0000 7f87e9053700 1 Processor -- start 2020-11-20T11:50:20.270 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.266+0000 7f87e9053700 1 -- start start 2020-11-20T11:50:20.272 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e9053700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f87e40650f0 0x7f87e4062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.273 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e9053700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f87e4151c40 0x7f87e4067030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.273 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e9053700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e4062a60 con 0x7f87e4064d10 2020-11-20T11:50:20.273 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e9053700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e4067520 con 0x7f87e40650f0 2020-11-20T11:50:20.273 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e9053700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e4062520 con 0x7f87e4151c40 2020-11-20T11:50:20.273 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e359e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f87e4151c40 0x7f87e4067030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.274 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e359e700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f87e4151c40 0x7f87e4067030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43842/0 (socket says 172.21.15.188:43842) 2020-11-20T11:50:20.274 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e359e700 1 -- 172.21.15.188:0/3037419797 learned_addr learned my addr 172.21.15.188:0/3037419797 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:20.274 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e259c700 1 --2- 172.21.15.188:0/3037419797 >> v2:172.21.15.164:3300/0 conn(0x7f87e40650f0 0x7f87e4062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.274 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e359e700 1 -- 172.21.15.188:0/3037419797 >> v2:172.21.15.164:3300/0 conn(0x7f87e40650f0 msgr2=0x7f87e4062ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:20.275 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e359e700 1 --2- 172.21.15.188:0/3037419797 >> v2:172.21.15.164:3300/0 conn(0x7f87e40650f0 0x7f87e4062ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.275 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e359e700 1 -- 172.21.15.188:0/3037419797 >> v1:172.21.15.36:6789/0 conn(0x7f87e4064d10 legacy=0x7f87e40baf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.275 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e359e700 1 -- 172.21.15.188:0/3037419797 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e41520d0 con 0x7f87e4151c40 2020-11-20T11:50:20.275 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e259c700 1 --2- 172.21.15.188:0/3037419797 >> v2:172.21.15.164:3300/0 conn(0x7f87e40650f0 0x7f87e4062ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:20.275 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e359e700 1 --2- 172.21.15.188:0/3037419797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e4151c40 0x7f87e4067030 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f87e4155730 tx=0x7f87dc0092d0).ready entity=mon.2 client_cookie=901b3fbc197fffb4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:20.276 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e1d9b700 1 -- 172.21.15.188:0/3037419797 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc00bc80 con 0x7f87e4151c40 2020-11-20T11:50:20.276 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e1d9b700 1 -- 172.21.15.188:0/3037419797 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc00bde0 con 0x7f87e4151c40 2020-11-20T11:50:20.276 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.267+0000 7f87e1d9b700 1 -- 172.21.15.188:0/3037419797 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc011610 con 0x7f87e4151c40 2020-11-20T11:50:20.276 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.268+0000 7f87e9053700 1 -- 172.21.15.188:0/3037419797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e4151c40 msgr2=0x7f87e4067030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.277 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.268+0000 7f87e9053700 1 --2- 172.21.15.188:0/3037419797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e4151c40 0x7f87e4067030 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f87e4155730 tx=0x7f87dc0092d0).stop 2020-11-20T11:50:20.277 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.268+0000 7f87e9053700 1 -- 172.21.15.188:0/3037419797 shutdown_connections 2020-11-20T11:50:20.277 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.268+0000 7f87e9053700 1 --2- 172.21.15.188:0/3037419797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e4151c40 0x7f87e4067030 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.277 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.268+0000 7f87e9053700 1 --2- 172.21.15.188:0/3037419797 >> v2:172.21.15.164:3300/0 conn(0x7f87e40650f0 0x7f87e4062ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.278 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.268+0000 7f87e9053700 1 -- 172.21.15.188:0/3037419797 >> 172.21.15.188:0/3037419797 conn(0x7f87e40c55c0 msgr2=0x7f87e40c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:20.279 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.268+0000 7f87e9053700 1 -- 172.21.15.188:0/3037419797 shutdown_connections 2020-11-20T11:50:20.279 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.268+0000 7f87e9053700 1 -- 172.21.15.188:0/3037419797 wait complete. 2020-11-20T11:50:20.282 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.269+0000 7f87e9053700 1 Processor -- start 2020-11-20T11:50:20.282 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.269+0000 7f87e9053700 1 -- start start 2020-11-20T11:50:20.282 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e9053700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e4064d10 0x7f87e4157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.282 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e9053700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e40650f0 0x7f87e4150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.283 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e9053700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e4151c40 0x7f87e41538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.283 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e9053700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e41546f0 con 0x7f87e4064d10 2020-11-20T11:50:20.283 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e9053700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4154990 con 0x7f87e4151c40 2020-11-20T11:50:20.283 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e9053700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4154c30 con 0x7f87e40650f0 2020-11-20T11:50:20.283 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e259c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e40650f0 0x7f87e4150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.284 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e259c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e40650f0 0x7f87e4150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43846/0 (socket says 172.21.15.188:43846) 2020-11-20T11:50:20.284 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e259c700 1 -- 172.21.15.188:0/1958759386 learned_addr learned my addr 172.21.15.188:0/1958759386 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:20.284 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e359e700 1 --2- 172.21.15.188:0/1958759386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e4151c40 0x7f87e41538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.284 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e2d9d700 1 --2- 172.21.15.188:0/1958759386 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e4064d10 0x7f87e4157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.285 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e259c700 1 -- 172.21.15.188:0/1958759386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e4151c40 msgr2=0x7f87e41538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.285 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.270+0000 7f87e259c700 1 --2- 172.21.15.188:0/1958759386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e4151c40 0x7f87e41538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.285 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87e259c700 1 -- 172.21.15.188:0/1958759386 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e4064d10 msgr2=0x7f87e4157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.285 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87e259c700 1 --2- 172.21.15.188:0/1958759386 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e4064d10 0x7f87e4157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.285 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87e259c700 1 -- 172.21.15.188:0/1958759386 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e4154ed0 con 0x7f87e40650f0 2020-11-20T11:50:20.286 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87e259c700 1 --2- 172.21.15.188:0/1958759386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e40650f0 0x7f87e4150580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f87d400db60 tx=0x7f87d4008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:20.286 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87caffd700 1 -- 172.21.15.188:0/1958759386 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400de70 con 0x7f87e40650f0 2020-11-20T11:50:20.286 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87caffd700 1 -- 172.21.15.188:0/1958759386 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d40097c0 con 0x7f87e40650f0 2020-11-20T11:50:20.286 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87e9053700 1 -- 172.21.15.188:0/1958759386 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e4155170 con 0x7f87e40650f0 2020-11-20T11:50:20.287 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87caffd700 1 -- 172.21.15.188:0/1958759386 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4009b80 con 0x7f87e40650f0 2020-11-20T11:50:20.287 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87e9053700 1 -- 172.21.15.188:0/1958759386 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e4150a70 con 0x7f87e40650f0 2020-11-20T11:50:20.287 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87caffd700 1 -- 172.21.15.188:0/1958759386 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f87d4006280 con 0x7f87e40650f0 2020-11-20T11:50:20.287 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.271+0000 7f87caffd700 1 -- 172.21.15.188:0/1958759386 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f87d4005d80 con 0x7f87e40650f0 2020-11-20T11:50:20.288 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.272+0000 7f87e9053700 1 -- 172.21.15.188:0/1958759386 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e4150d50 con 0x7f87e40650f0 2020-11-20T11:50:20.288 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.274+0000 7f87caffd700 1 -- 172.21.15.188:0/1958759386 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f87d4005930 con 0x7f87e40650f0 2020-11-20T11:50:20.367 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.363+0000 7f87e9053700 1 -- 172.21.15.188:0/1958759386 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8478d740-989b-4d1a-8e40-6dff71e4b289", "id": 2} v 0) v1 -- 0x7f87e4069b70 con 0x7f87e40650f0 2020-11-20T11:50:20.374 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.370+0000 7f87caffd700 1 -- 172.21.15.188:0/1958759386 <== mon.2 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8478d740-989b-4d1a-8e40-6dff71e4b289", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f87d4005b50 con 0x7f87e40650f0 2020-11-20T11:50:20.375 INFO:teuthology.orchestra.run.smithi188.stdout:2 2020-11-20T11:50:20.376 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.371+0000 7f87e9053700 1 -- 172.21.15.188:0/1958759386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e40650f0 msgr2=0x7f87e4150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.376 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.371+0000 7f87e9053700 1 --2- 172.21.15.188:0/1958759386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e40650f0 0x7f87e4150580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f87d400db60 tx=0x7f87d4008040).stop 2020-11-20T11:50:20.376 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.371+0000 7f87e9053700 1 -- 172.21.15.188:0/1958759386 shutdown_connections 2020-11-20T11:50:20.377 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.371+0000 7f87e9053700 1 --2- 172.21.15.188:0/1958759386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e4151c40 0x7f87e41538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.377 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.371+0000 7f87e9053700 1 --2- 172.21.15.188:0/1958759386 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e4064d10 0x7f87e4157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.377 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.371+0000 7f87e9053700 1 --2- 172.21.15.188:0/1958759386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87e40650f0 0x7f87e4150580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.377 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.371+0000 7f87e9053700 1 -- 172.21.15.188:0/1958759386 >> 172.21.15.188:0/1958759386 conn(0x7f87e40c55c0 msgr2=0x7f87e40bb730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:20.377 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.371+0000 7f87e9053700 1 -- 172.21.15.188:0/1958759386 shutdown_connections 2020-11-20T11:50:20.378 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.371+0000 7f87e9053700 1 -- 172.21.15.188:0/1958759386 wait complete. 2020-11-20T11:50:20.386 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 4891bc60-773c-4fdf-991a-608f802e782f 3 2020-11-20T11:50:20.497 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.493+0000 7f349f5fc700 1 Processor -- start 2020-11-20T11:50:20.498 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.493+0000 7f349f5fc700 1 -- start start 2020-11-20T11:50:20.500 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.494+0000 7f349f5fc700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34980c1520 0x7f3498065d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.500 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.494+0000 7f349f5fc700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349814e0e0 con 0x7f34980ba920 2020-11-20T11:50:20.500 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.494+0000 7f349f5fc700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349814e380 con 0x7f34980c1140 2020-11-20T11:50:20.500 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.494+0000 7f349f5fc700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349814e620 con 0x7f34980c1520 2020-11-20T11:50:20.501 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.494+0000 7f349db99700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34980c1520 0x7f3498065d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.501 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.494+0000 7f349d398700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f34980c1140 0x7f3498151d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:51298/0 (socket says 172.21.15.188:51298) 2020-11-20T11:50:20.501 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.494+0000 7f349db99700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34980c1520 0x7f3498065d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43854/0 (socket says 172.21.15.188:43854) 2020-11-20T11:50:20.501 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.494+0000 7f349d398700 1 -- 172.21.15.188:0/1814412122 learned_addr learned my addr 172.21.15.188:0/1814412122 (peer_addr_for_me v1:172.21.15.188:0/0) 2020-11-20T11:50:20.501 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.495+0000 7f349db99700 1 -- 172.21.15.188:0/1814412122 >> v1:172.21.15.188:6789/0 conn(0x7f34980c1140 legacy=0x7f3498151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.502 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.495+0000 7f349db99700 1 -- 172.21.15.188:0/1814412122 >> v1:172.21.15.164:6789/0 conn(0x7f34980ba920 legacy=0x7f3498065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.502 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.495+0000 7f3487fff700 1 -- 172.21.15.188:0/1814412122 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227434456 0 0) 0x7f349814e380 con 0x7f34980c1140 2020-11-20T11:50:20.502 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.495+0000 7f349db99700 1 -- 172.21.15.188:0/1814412122 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349814e8c0 con 0x7f34980c1520 2020-11-20T11:50:20.502 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.495+0000 7f349db99700 1 --2- 172.21.15.188:0/1814412122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 0x7f3498065d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f3490009ce0 tx=0x7f3490009220).ready entity=mon.2 client_cookie=2e012cee6655baee server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:20.502 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.495+0000 7f3487fff700 1 -- 172.21.15.188:0/1814412122 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000bbf0 con 0x7f34980c1520 2020-11-20T11:50:20.503 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.495+0000 7f3487fff700 1 -- 172.21.15.188:0/1814412122 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000bd50 con 0x7f34980c1520 2020-11-20T11:50:20.503 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.495+0000 7f3487fff700 1 -- 172.21.15.188:0/1814412122 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490011610 con 0x7f34980c1520 2020-11-20T11:50:20.503 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.496+0000 7f349f5fc700 1 -- 172.21.15.188:0/1814412122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 msgr2=0x7f3498065d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.503 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.496+0000 7f349f5fc700 1 --2- 172.21.15.188:0/1814412122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 0x7f3498065d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f3490009ce0 tx=0x7f3490009220).stop 2020-11-20T11:50:20.503 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.496+0000 7f349f5fc700 1 -- 172.21.15.188:0/1814412122 shutdown_connections 2020-11-20T11:50:20.504 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.496+0000 7f349f5fc700 1 --2- 172.21.15.188:0/1814412122 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 0x7f3498065d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.504 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.496+0000 7f349f5fc700 1 -- 172.21.15.188:0/1814412122 >> 172.21.15.188:0/1814412122 conn(0x7f34980612c0 msgr2=0x7f34980616d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:20.505 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.496+0000 7f349f5fc700 1 -- 172.21.15.188:0/1814412122 shutdown_connections 2020-11-20T11:50:20.505 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.496+0000 7f349f5fc700 1 -- 172.21.15.188:0/1814412122 wait complete. 2020-11-20T11:50:20.508 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.497+0000 7f349f5fc700 1 Processor -- start 2020-11-20T11:50:20.508 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.497+0000 7f349f5fc700 1 -- start start 2020-11-20T11:50:20.508 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349f5fc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980ba920 0x7f3498151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.508 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349f5fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34980c1140 0x7f3498092290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.508 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349f5fc700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 0x7f3498147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.510 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349f5fc700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349809cee0 con 0x7f34980c1140 2020-11-20T11:50:20.510 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349f5fc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349815df00 con 0x7f34980ba920 2020-11-20T11:50:20.510 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349f5fc700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349815e1a0 con 0x7f34980c1520 2020-11-20T11:50:20.510 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349db99700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 0x7f3498147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.510 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349db99700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 0x7f3498147970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43860/0 (socket says 172.21.15.188:43860) 2020-11-20T11:50:20.511 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349db99700 1 -- 172.21.15.188:0/1656929599 learned_addr learned my addr 172.21.15.188:0/1656929599 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:20.511 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349d398700 1 --2- 172.21.15.188:0/1656929599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980ba920 0x7f3498151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.511 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349cb97700 1 --2- 172.21.15.188:0/1656929599 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34980c1140 0x7f3498092290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.511 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349db99700 1 -- 172.21.15.188:0/1656929599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980ba920 msgr2=0x7f3498151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.511 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349db99700 1 --2- 172.21.15.188:0/1656929599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980ba920 0x7f3498151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.512 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349db99700 1 -- 172.21.15.188:0/1656929599 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34980c1140 msgr2=0x7f3498092290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.512 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349db99700 1 --2- 172.21.15.188:0/1656929599 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34980c1140 0x7f3498092290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.512 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349db99700 1 -- 172.21.15.188:0/1656929599 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349815e440 con 0x7f34980c1520 2020-11-20T11:50:20.512 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349db99700 1 --2- 172.21.15.188:0/1656929599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 0x7f3498147970 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3490009260 tx=0x7f3490016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:20.512 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f34857fa700 1 -- 172.21.15.188:0/1656929599 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490009e20 con 0x7f34980c1520 2020-11-20T11:50:20.513 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f34857fa700 1 -- 172.21.15.188:0/1656929599 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490010ae0 con 0x7f34980c1520 2020-11-20T11:50:20.513 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349f5fc700 1 -- 172.21.15.188:0/1656929599 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349815e6e0 con 0x7f34980c1520 2020-11-20T11:50:20.513 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f34857fa700 1 -- 172.21.15.188:0/1656929599 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490010e80 con 0x7f34980c1520 2020-11-20T11:50:20.513 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.498+0000 7f349f5fc700 1 -- 172.21.15.188:0/1656929599 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3498092780 con 0x7f34980c1520 2020-11-20T11:50:20.513 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.499+0000 7f34857fa700 1 -- 172.21.15.188:0/1656929599 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f3490017070 con 0x7f34980c1520 2020-11-20T11:50:20.514 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.499+0000 7f34857fa700 1 -- 172.21.15.188:0/1656929599 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f3490027920 con 0x7f34980c1520 2020-11-20T11:50:20.515 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.499+0000 7f349f5fc700 1 -- 172.21.15.188:0/1656929599 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349815eb40 con 0x7f34980c1520 2020-11-20T11:50:20.515 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.501+0000 7f34857fa700 1 -- 172.21.15.188:0/1656929599 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f3490015020 con 0x7f34980c1520 2020-11-20T11:50:20.583 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.579+0000 7f349f5fc700 1 -- 172.21.15.188:0/1656929599 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4891bc60-773c-4fdf-991a-608f802e782f", "id": 3} v 0) v1 -- 0x7f3498069b70 con 0x7f34980c1520 2020-11-20T11:50:20.587 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.583+0000 7f34857fa700 1 -- 172.21.15.188:0/1656929599 <== mon.2 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4891bc60-773c-4fdf-991a-608f802e782f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f349001da80 con 0x7f34980c1520 2020-11-20T11:50:20.587 INFO:teuthology.orchestra.run.smithi188.stdout:3 2020-11-20T11:50:20.588 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.584+0000 7f349f5fc700 1 -- 172.21.15.188:0/1656929599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 msgr2=0x7f3498147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.589 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.584+0000 7f349f5fc700 1 --2- 172.21.15.188:0/1656929599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 0x7f3498147970 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3490009260 tx=0x7f3490016000).stop 2020-11-20T11:50:20.589 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.584+0000 7f349f5fc700 1 -- 172.21.15.188:0/1656929599 shutdown_connections 2020-11-20T11:50:20.589 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.584+0000 7f349f5fc700 1 --2- 172.21.15.188:0/1656929599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980ba920 0x7f3498151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.589 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.584+0000 7f349f5fc700 1 --2- 172.21.15.188:0/1656929599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34980c1520 0x7f3498147970 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.590 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.584+0000 7f349f5fc700 1 --2- 172.21.15.188:0/1656929599 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34980c1140 0x7f3498092290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.590 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.584+0000 7f349f5fc700 1 -- 172.21.15.188:0/1656929599 >> 172.21.15.188:0/1656929599 conn(0x7f34980612c0 msgr2=0x7f34980bc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:20.590 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.584+0000 7f349f5fc700 1 -- 172.21.15.188:0/1656929599 shutdown_connections 2020-11-20T11:50:20.590 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.584+0000 7f349f5fc700 1 -- 172.21.15.188:0/1656929599 wait complete. 2020-11-20T11:50:20.599 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 2d95ba05-a3a3-443a-8653-cfdad980c161 4 2020-11-20T11:50:20.758 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.717+0000 7fe6b0d12700 1 Processor -- start 2020-11-20T11:50:20.758 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.717+0000 7fe6b0d12700 1 -- start start 2020-11-20T11:50:20.759 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.718+0000 7fe6b0d12700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac152500 con 0x7fe6ac065260 2020-11-20T11:50:20.759 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.718+0000 7fe6b0d12700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac152730 con 0x7fe6ac0bd4d0 2020-11-20T11:50:20.759 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.718+0000 7fe6b0d12700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac1529d0 con 0x7fe6ac063870 2020-11-20T11:50:20.760 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.718+0000 7fe6aad9d700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe6ac063870 0x7fe6ac14f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:51310/0 (socket says 172.21.15.188:51310) 2020-11-20T11:50:20.760 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.718+0000 7fe6aad9d700 1 -- 172.21.15.188:0/3194943707 learned_addr learned my addr 172.21.15.188:0/3194943707 (peer_addr_for_me v1:172.21.15.188:0/0) 2020-11-20T11:50:20.760 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205304632 0 0) 0x7fe6ac1529d0 con 0x7fe6ac063870 2020-11-20T11:50:20.762 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe690003280 con 0x7fe6ac063870 2020-11-20T11:50:20.769 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518847258 0 0) 0x7fe6ac152730 con 0x7fe6ac0bd4d0 2020-11-20T11:50:20.771 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6ac1529d0 con 0x7fe6ac0bd4d0 2020-11-20T11:50:20.774 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683766975 0 0) 0x7fe6ac152500 con 0x7fe6ac065260 2020-11-20T11:50:20.775 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6ac152730 con 0x7fe6ac065260 2020-11-20T11:50:20.777 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 <== mon.2 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 373301434 0 0) 0x7fe690003280 con 0x7fe6ac063870 2020-11-20T11:50:20.778 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 >> v1:172.21.15.164:6789/0 conn(0x7fe6ac0bd4d0 legacy=0x7fe6ac064b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.783 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 >> v1:172.21.15.36:6789/0 conn(0x7fe6ac065260 legacy=0x7fe6ac14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.785 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac152c70 con 0x7fe6ac063870 2020-11-20T11:50:20.786 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 <== mon.2 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fe6a40018e0 con 0x7fe6ac063870 2020-11-20T11:50:20.787 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 >> v1:172.21.15.188:6789/0 conn(0x7fe6ac063870 legacy=0x7fe6ac14f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.788 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe690003ae0 0x7fe690003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.789 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe690004520 0x7fe6900049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.790 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe690004ff0 0x7fe69000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.790 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69000bd00 con 0x7fe690004520 2020-11-20T11:50:20.792 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69000be70 con 0x7fe690003ae0 2020-11-20T11:50:20.792 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69000c030 con 0x7fe690004ff0 2020-11-20T11:50:20.792 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6aad9d700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe690004ff0 0x7fe69000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.793 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6aa59c700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe690003ae0 0x7fe690003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.793 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6a9d9b700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe690004520 0x7fe6900049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.793 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6aad9d700 1 -- 172.21.15.188:0/3194943707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe690003ae0 msgr2=0x7fe690003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:20.794 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6aad9d700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe690003ae0 0x7fe690003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.794 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6aad9d700 1 -- 172.21.15.188:0/3194943707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe690004520 msgr2=0x7fe6900049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:20.794 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6aad9d700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe690004520 0x7fe6900049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.794 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6aad9d700 1 -- 172.21.15.188:0/3194943707 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe690003280 con 0x7fe690004ff0 2020-11-20T11:50:20.794 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6aad9d700 1 -- 172.21.15.188:0/3194943707 reap_dead start 2020-11-20T11:50:20.795 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.719+0000 7fe6aad9d700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe690004ff0 0x7fe69000b770 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe6a400c600 tx=0x7fe6a4007b10).ready entity=mon.2 client_cookie=a99d1fb26ea63c45 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:20.795 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.720+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4005bc0 con 0x7fe690004ff0 2020-11-20T11:50:20.795 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.720+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a4005d20 con 0x7fe690004ff0 2020-11-20T11:50:20.795 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.720+0000 7fe6a959a700 1 -- 172.21.15.188:0/3194943707 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4007320 con 0x7fe690004ff0 2020-11-20T11:50:20.795 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.720+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3194943707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe690004ff0 msgr2=0x7fe69000b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.796 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.720+0000 7fe6b0d12700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe690004ff0 0x7fe69000b770 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe6a400c600 tx=0x7fe6a4007b10).stop 2020-11-20T11:50:20.796 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.720+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3194943707 shutdown_connections 2020-11-20T11:50:20.796 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.720+0000 7fe6b0d12700 1 --2- 172.21.15.188:0/3194943707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe690004ff0 0x7fe69000b770 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.796 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.720+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3194943707 >> 172.21.15.188:0/3194943707 conn(0x7fe6ac067130 msgr2=0x7fe6ac062d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:20.796 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.720+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3194943707 shutdown_connections 2020-11-20T11:50:20.797 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.720+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3194943707 wait complete. 2020-11-20T11:50:20.797 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.721+0000 7fe6b0d12700 1 Processor -- start 2020-11-20T11:50:20.797 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.721+0000 7fe6b0d12700 1 -- start start 2020-11-20T11:50:20.798 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6b0d12700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe690004ff0 0x7fe6ac162a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.798 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6b0d12700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6ac15f7b0 0x7fe6ac147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.799 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6b0d12700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ac1510a0 0x7fe6ac147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.800 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6b0d12700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac15eba0 con 0x7fe6ac15f7b0 2020-11-20T11:50:20.800 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6b0d12700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac1515a0 con 0x7fe690004ff0 2020-11-20T11:50:20.800 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6b0d12700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac151840 con 0x7fe6ac1510a0 2020-11-20T11:50:20.800 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6aad9d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ac1510a0 0x7fe6ac147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.800 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6aad9d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ac1510a0 0x7fe6ac147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43876/0 (socket says 172.21.15.188:43876) 2020-11-20T11:50:20.801 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6aa59c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe690004ff0 0x7fe6ac162a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.801 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6aad9d700 1 -- 172.21.15.188:0/3889243845 learned_addr learned my addr 172.21.15.188:0/3889243845 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:20.801 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6a9d9b700 1 --2- 172.21.15.188:0/3889243845 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6ac15f7b0 0x7fe6ac147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.801 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6aad9d700 1 -- 172.21.15.188:0/3889243845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe690004ff0 msgr2=0x7fe6ac162a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.801 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6aad9d700 1 --2- 172.21.15.188:0/3889243845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe690004ff0 0x7fe6ac162a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.802 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6aad9d700 1 -- 172.21.15.188:0/3889243845 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6ac15f7b0 msgr2=0x7fe6ac147220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.802 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6aad9d700 1 --2- 172.21.15.188:0/3889243845 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6ac15f7b0 0x7fe6ac147220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.802 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.722+0000 7fe6aad9d700 1 -- 172.21.15.188:0/3889243845 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac15edd0 con 0x7fe6ac1510a0 2020-11-20T11:50:20.802 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.723+0000 7fe6aad9d700 1 --2- 172.21.15.188:0/3889243845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ac1510a0 0x7fe6ac147710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe6ac067100 tx=0x7fe6a4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:20.803 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.723+0000 7fe69a7fc700 1 -- 172.21.15.188:0/3889243845 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4001360 con 0x7fe6ac1510a0 2020-11-20T11:50:20.803 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.723+0000 7fe69a7fc700 1 -- 172.21.15.188:0/3889243845 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a40048c0 con 0x7fe6ac1510a0 2020-11-20T11:50:20.803 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.723+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3889243845 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac15f070 con 0x7fe6ac1510a0 2020-11-20T11:50:20.803 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.723+0000 7fe69a7fc700 1 -- 172.21.15.188:0/3889243845 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4004c60 con 0x7fe6ac1510a0 2020-11-20T11:50:20.803 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.723+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3889243845 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac1520e0 con 0x7fe6ac1510a0 2020-11-20T11:50:20.803 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.723+0000 7fe69a7fc700 1 -- 172.21.15.188:0/3889243845 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fe6a401d070 con 0x7fe6ac1510a0 2020-11-20T11:50:20.804 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.723+0000 7fe69a7fc700 1 -- 172.21.15.188:0/3889243845 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fe6a40015f0 con 0x7fe6ac1510a0 2020-11-20T11:50:20.804 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.724+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3889243845 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ac069b70 con 0x7fe6ac1510a0 2020-11-20T11:50:20.804 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.726+0000 7fe69a7fc700 1 -- 172.21.15.188:0/3889243845 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fe6a402d060 con 0x7fe6ac1510a0 2020-11-20T11:50:20.808 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.804+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3889243845 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2d95ba05-a3a3-443a-8653-cfdad980c161", "id": 4} v 0) v1 -- 0x7fe6ac0c3a60 con 0x7fe6ac1510a0 2020-11-20T11:50:20.813 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.808+0000 7fe69a7fc700 1 -- 172.21.15.188:0/3889243845 <== mon.2 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d95ba05-a3a3-443a-8653-cfdad980c161", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6a401a070 con 0x7fe6ac1510a0 2020-11-20T11:50:20.813 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.809+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3889243845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ac1510a0 msgr2=0x7fe6ac147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.813 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.809+0000 7fe6b0d12700 1 --2- 172.21.15.188:0/3889243845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ac1510a0 0x7fe6ac147710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe6ac067100 tx=0x7fe6a4015000).stop 2020-11-20T11:50:20.814 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.809+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3889243845 shutdown_connections 2020-11-20T11:50:20.814 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.809+0000 7fe6b0d12700 1 --2- 172.21.15.188:0/3889243845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe690004ff0 0x7fe6ac162a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.814 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.809+0000 7fe6b0d12700 1 --2- 172.21.15.188:0/3889243845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ac1510a0 0x7fe6ac147710 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.814 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.809+0000 7fe6b0d12700 1 --2- 172.21.15.188:0/3889243845 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6ac15f7b0 0x7fe6ac147220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.814 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.809+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3889243845 >> 172.21.15.188:0/3889243845 conn(0x7fe6ac067130 msgr2=0x7fe6ac0c2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:20.815 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.809+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3889243845 shutdown_connections 2020-11-20T11:50:20.815 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.809+0000 7fe6b0d12700 1 -- 172.21.15.188:0/3889243845 wait complete. 2020-11-20T11:50:20.815 INFO:teuthology.orchestra.run.smithi188.stdout:4 2020-11-20T11:50:20.832 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new f5e0530b-a407-45a4-8cc4-2ec32b722510 5 2020-11-20T11:50:20.950 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.946+0000 7fbaa8fa3700 1 Processor -- start 2020-11-20T11:50:20.950 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.946+0000 7fbaa8fa3700 1 -- start start 2020-11-20T11:50:20.953 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa8fa3700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbaa4148da0 0x7fbaa40bf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.953 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa8fa3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbaa4149180 0x7fbaa40bc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.953 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa8fa3700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa40bfcc0 con 0x7fbaa40bde30 2020-11-20T11:50:20.953 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa8fa3700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa414f050 con 0x7fbaa4149180 2020-11-20T11:50:20.954 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa8fa3700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa414f2f0 con 0x7fbaa4148da0 2020-11-20T11:50:20.954 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa259c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbaa4148da0 0x7fbaa40bf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.954 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa2d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbaa4149180 0x7fbaa40bc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.954 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa259c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbaa4148da0 0x7fbaa40bf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.188:34242/0 (socket says 172.21.15.188:34242) 2020-11-20T11:50:20.954 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa2d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbaa4149180 0x7fbaa40bc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.188:33542/0 (socket says 172.21.15.188:33542) 2020-11-20T11:50:20.955 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa1d9b700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fbaa40bde30 0x7fbaa4067ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.188:46084/0 (socket says 172.21.15.188:46084) 2020-11-20T11:50:20.955 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa259c700 1 -- 172.21.15.188:0/2999823831 learned_addr learned my addr 172.21.15.188:0/2999823831 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:20.955 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa259c700 1 -- 172.21.15.188:0/2999823831 >> v2:172.21.15.36:3300/0 conn(0x7fbaa4149180 msgr2=0x7fbaa40bc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:20.955 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa259c700 1 --2- 172.21.15.188:0/2999823831 >> v2:172.21.15.36:3300/0 conn(0x7fbaa4149180 0x7fbaa40bc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.956 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa259c700 1 -- 172.21.15.188:0/2999823831 >> v1:172.21.15.164:6789/0 conn(0x7fbaa40bde30 legacy=0x7fbaa4067ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.956 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa259c700 1 -- 172.21.15.188:0/2999823831 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa414f590 con 0x7fbaa4148da0 2020-11-20T11:50:20.956 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa159a700 1 -- 172.21.15.188:0/2999823831 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830333688 0 0) 0x7fbaa40bfcc0 con 0x7fbaa40bde30 2020-11-20T11:50:20.956 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.947+0000 7fbaa2d9d700 1 --2- 172.21.15.188:0/2999823831 >> v2:172.21.15.36:3300/0 conn(0x7fbaa4149180 0x7fbaa40bc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:20.958 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa259c700 1 --2- 172.21.15.188:0/2999823831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbaa4148da0 0x7fbaa40bf520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fbaa405d2c0 tx=0x7fba94006ef0).ready entity=mon.1 client_cookie=15bb631a2be18d1b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:20.958 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa159a700 1 -- 172.21.15.188:0/2999823831 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9400b860 con 0x7fbaa4148da0 2020-11-20T11:50:20.958 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa159a700 1 -- 172.21.15.188:0/2999823831 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94000e90 con 0x7fbaa4148da0 2020-11-20T11:50:20.958 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa159a700 1 -- 172.21.15.188:0/2999823831 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9400bbd0 con 0x7fbaa4148da0 2020-11-20T11:50:20.959 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/2999823831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbaa4148da0 msgr2=0x7fbaa40bf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.959 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa8fa3700 1 --2- 172.21.15.188:0/2999823831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbaa4148da0 0x7fbaa40bf520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fbaa405d2c0 tx=0x7fba94006ef0).stop 2020-11-20T11:50:20.959 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/2999823831 shutdown_connections 2020-11-20T11:50:20.960 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa8fa3700 1 --2- 172.21.15.188:0/2999823831 >> v2:172.21.15.36:3300/0 conn(0x7fbaa4149180 0x7fbaa40bc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.960 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa8fa3700 1 --2- 172.21.15.188:0/2999823831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbaa4148da0 0x7fbaa40bf520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.960 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/2999823831 >> 172.21.15.188:0/2999823831 conn(0x7fbaa4060c80 msgr2=0x7fbaa40c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:20.960 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/2999823831 shutdown_connections 2020-11-20T11:50:20.961 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.948+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/2999823831 wait complete. 2020-11-20T11:50:20.964 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.949+0000 7fbaa8fa3700 1 Processor -- start 2020-11-20T11:50:20.965 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.949+0000 7fbaa8fa3700 1 -- start start 2020-11-20T11:50:20.965 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa8fa3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbaa40bde30 0x7fbaa4140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.965 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa8fa3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbaa4148da0 0x7fbaa4064af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.965 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa8fa3700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaa4149180 0x7fbaa4163c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:20.966 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa8fa3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41520b0 con 0x7fbaa40bde30 2020-11-20T11:50:20.966 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa8fa3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41412b0 con 0x7fbaa4148da0 2020-11-20T11:50:20.966 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa8fa3700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4141550 con 0x7fbaa4149180 2020-11-20T11:50:20.966 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa2d9d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaa4149180 0x7fbaa4163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.967 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa2d9d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaa4149180 0x7fbaa4163c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43884/0 (socket says 172.21.15.188:43884) 2020-11-20T11:50:20.967 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa2d9d700 1 -- 172.21.15.188:0/3664291451 learned_addr learned my addr 172.21.15.188:0/3664291451 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa1d9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbaa4148da0 0x7fbaa4064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.950+0000 7fbaa259c700 1 --2- 172.21.15.188:0/3664291451 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbaa40bde30 0x7fbaa4140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:20.968 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fbaa2d9d700 1 -- 172.21.15.188:0/3664291451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbaa4148da0 msgr2=0x7fbaa4064af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.969 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fbaa2d9d700 1 --2- 172.21.15.188:0/3664291451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbaa4148da0 0x7fbaa4064af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.969 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fbaa2d9d700 1 -- 172.21.15.188:0/3664291451 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbaa40bde30 msgr2=0x7fbaa4140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:20.969 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fbaa2d9d700 1 --2- 172.21.15.188:0/3664291451 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbaa40bde30 0x7fbaa4140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:20.969 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fbaa2d9d700 1 -- 172.21.15.188:0/3664291451 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40baf20 con 0x7fbaa4149180 2020-11-20T11:50:20.970 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fbaa2d9d700 1 --2- 172.21.15.188:0/3664291451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaa4149180 0x7fbaa4163c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fba9c00ef50 tx=0x7fba9c009220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:20.970 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fba927fc700 1 -- 172.21.15.188:0/3664291451 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00cc10 con 0x7fbaa4149180 2020-11-20T11:50:20.970 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fba927fc700 1 -- 172.21.15.188:0/3664291451 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c00cd70 con 0x7fbaa4149180 2020-11-20T11:50:20.971 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fba927fc700 1 -- 172.21.15.188:0/3664291451 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c012620 con 0x7fbaa4149180 2020-11-20T11:50:20.971 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/3664291451 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa40bb1c0 con 0x7fbaa4149180 2020-11-20T11:50:20.972 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.951+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/3664291451 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa40bb700 con 0x7fbaa4149180 2020-11-20T11:50:20.972 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.952+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/3664291451 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa40bb8c0 con 0x7fbaa4149180 2020-11-20T11:50:20.972 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.952+0000 7fba927fc700 1 -- 172.21.15.188:0/3664291451 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fba9c022070 con 0x7fbaa4149180 2020-11-20T11:50:20.972 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.952+0000 7fba927fc700 1 -- 172.21.15.188:0/3664291451 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fba9c01baa0 con 0x7fbaa4149180 2020-11-20T11:50:20.973 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:20.954+0000 7fba927fc700 1 -- 172.21.15.188:0/3664291451 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fba9c016020 con 0x7fbaa4149180 2020-11-20T11:50:21.035 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.031+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/3664291451 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f5e0530b-a407-45a4-8cc4-2ec32b722510", "id": 5} v 0) v1 -- 0x7fbaa4069b70 con 0x7fbaa4149180 2020-11-20T11:50:21.038 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.034+0000 7fba927fc700 1 -- 172.21.15.188:0/3664291451 <== mon.2 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5e0530b-a407-45a4-8cc4-2ec32b722510", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fba9c01be50 con 0x7fbaa4149180 2020-11-20T11:50:21.039 INFO:teuthology.orchestra.run.smithi188.stdout:5 2020-11-20T11:50:21.040 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.035+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/3664291451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaa4149180 msgr2=0x7fbaa4163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.040 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.035+0000 7fbaa8fa3700 1 --2- 172.21.15.188:0/3664291451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaa4149180 0x7fbaa4163c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fba9c00ef50 tx=0x7fba9c009220).stop 2020-11-20T11:50:21.040 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.035+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/3664291451 shutdown_connections 2020-11-20T11:50:21.040 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.035+0000 7fbaa8fa3700 1 --2- 172.21.15.188:0/3664291451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaa4149180 0x7fbaa4163c40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.041 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.035+0000 7fbaa8fa3700 1 --2- 172.21.15.188:0/3664291451 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbaa40bde30 0x7fbaa4140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.041 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.035+0000 7fbaa8fa3700 1 --2- 172.21.15.188:0/3664291451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbaa4148da0 0x7fbaa4064af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.041 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.035+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/3664291451 >> 172.21.15.188:0/3664291451 conn(0x7fbaa4060c80 msgr2=0x7fbaa41435f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:21.041 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.035+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/3664291451 shutdown_connections 2020-11-20T11:50:21.041 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.035+0000 7fbaa8fa3700 1 -- 172.21.15.188:0/3664291451 wait complete. 2020-11-20T11:50:21.051 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 84225f1e-f6bb-4587-994b-0db5e9c2412e 6 2020-11-20T11:50:21.171 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.167+0000 7fdac178c700 1 Processor -- start 2020-11-20T11:50:21.171 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.167+0000 7fdac178c700 1 -- start start 2020-11-20T11:50:21.173 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.167+0000 7fdac178c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdabc0bce20 0x7fdabc152e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.173 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.167+0000 7fdac178c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fdabc067420 0x7fdabc0678b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.174 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.167+0000 7fdac178c700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc0bf900 con 0x7fdabc0bca40 2020-11-20T11:50:21.174 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.167+0000 7fdac178c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc153310 con 0x7fdabc067420 2020-11-20T11:50:21.174 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.167+0000 7fdac178c700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc14f030 con 0x7fdabc0bce20 2020-11-20T11:50:21.174 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabb7fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdabc0bce20 0x7fdabc152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.174 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabb7fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdabc0bce20 0x7fdabc152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43886/0 (socket says 172.21.15.188:43886) 2020-11-20T11:50:21.175 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabb7fe700 1 -- 172.21.15.188:0/2614766499 learned_addr learned my addr 172.21.15.188:0/2614766499 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:21.175 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdac0f8b700 1 --2- 172.21.15.188:0/2614766499 >> v2:172.21.15.36:3300/0 conn(0x7fdabc067420 0x7fdabc0678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.175 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabb7fe700 1 -- 172.21.15.188:0/2614766499 >> v2:172.21.15.36:3300/0 conn(0x7fdabc067420 msgr2=0x7fdabc0678b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:21.175 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabb7fe700 1 --2- 172.21.15.188:0/2614766499 >> v2:172.21.15.36:3300/0 conn(0x7fdabc067420 0x7fdabc0678b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.176 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabb7fe700 1 -- 172.21.15.188:0/2614766499 >> v1:172.21.15.164:6789/0 conn(0x7fdabc0bca40 legacy=0x7fdabc0bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.176 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabb7fe700 1 -- 172.21.15.188:0/2614766499 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc14f2d0 con 0x7fdabc0bce20 2020-11-20T11:50:21.176 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabb7fe700 1 --2- 172.21.15.188:0/2614766499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 0x7fdabc152e20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdabc068990 tx=0x7fdab0006ef0).ready entity=mon.2 client_cookie=c3bf9d4d22e53889 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:21.176 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabaffd700 1 -- 172.21.15.188:0/2614766499 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab000b8f0 con 0x7fdabc0bce20 2020-11-20T11:50:21.176 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabaffd700 1 -- 172.21.15.188:0/2614766499 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab0000e90 con 0x7fdabc0bce20 2020-11-20T11:50:21.177 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.168+0000 7fdabaffd700 1 -- 172.21.15.188:0/2614766499 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab000bc60 con 0x7fdabc0bce20 2020-11-20T11:50:21.177 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.169+0000 7fdac178c700 1 -- 172.21.15.188:0/2614766499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 msgr2=0x7fdabc152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.177 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.169+0000 7fdac178c700 1 --2- 172.21.15.188:0/2614766499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 0x7fdabc152e20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdabc068990 tx=0x7fdab0006ef0).stop 2020-11-20T11:50:21.177 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.169+0000 7fdac178c700 1 -- 172.21.15.188:0/2614766499 shutdown_connections 2020-11-20T11:50:21.177 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.169+0000 7fdac178c700 1 --2- 172.21.15.188:0/2614766499 >> v2:172.21.15.36:3300/0 conn(0x7fdabc067420 0x7fdabc0678b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.178 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.169+0000 7fdac178c700 1 --2- 172.21.15.188:0/2614766499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 0x7fdabc152e20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.178 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.169+0000 7fdac178c700 1 -- 172.21.15.188:0/2614766499 >> 172.21.15.188:0/2614766499 conn(0x7fdabc0c3230 msgr2=0x7fdabc0c3640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:21.178 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.169+0000 7fdac178c700 1 -- 172.21.15.188:0/2614766499 shutdown_connections 2020-11-20T11:50:21.179 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.169+0000 7fdac178c700 1 -- 172.21.15.188:0/2614766499 wait complete. 2020-11-20T11:50:21.181 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.170+0000 7fdac178c700 1 Processor -- start 2020-11-20T11:50:21.182 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.171+0000 7fdac178c700 1 -- start start 2020-11-20T11:50:21.182 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac178c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc067420 0x7fdabc0ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.182 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac178c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdabc0bca40 0x7fdabc14cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.182 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac178c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 0x7fdabc150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.183 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac178c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0ae2a0 con 0x7fdabc0bca40 2020-11-20T11:50:21.183 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac178c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc14d610 con 0x7fdabc067420 2020-11-20T11:50:21.183 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac178c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc14ad20 con 0x7fdabc0bce20 2020-11-20T11:50:21.183 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac0f8b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 0x7fdabc150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.183 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac0f8b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 0x7fdabc150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43896/0 (socket says 172.21.15.188:43896) 2020-11-20T11:50:21.184 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac0f8b700 1 -- 172.21.15.188:0/4121563880 learned_addr learned my addr 172.21.15.188:0/4121563880 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:21.184 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdabb7fe700 1 --2- 172.21.15.188:0/4121563880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdabc0bca40 0x7fdabc14cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.184 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdabbfff700 1 --2- 172.21.15.188:0/4121563880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc067420 0x7fdabc0ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.184 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac0f8b700 1 -- 172.21.15.188:0/4121563880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc067420 msgr2=0x7fdabc0ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.185 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac0f8b700 1 --2- 172.21.15.188:0/4121563880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc067420 0x7fdabc0ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.185 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac0f8b700 1 -- 172.21.15.188:0/4121563880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdabc0bca40 msgr2=0x7fdabc14cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.185 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac0f8b700 1 --2- 172.21.15.188:0/4121563880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdabc0bca40 0x7fdabc14cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.185 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac0f8b700 1 -- 172.21.15.188:0/4121563880 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0add60 con 0x7fdabc0bce20 2020-11-20T11:50:21.185 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.172+0000 7fdac0f8b700 1 --2- 172.21.15.188:0/4121563880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 0x7fdabc150b80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdab400ed20 tx=0x7fdab4009220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:21.186 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.173+0000 7fda9bfff700 1 -- 172.21.15.188:0/4121563880 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400ee80 con 0x7fdabc0bce20 2020-11-20T11:50:21.186 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.173+0000 7fda9bfff700 1 -- 172.21.15.188:0/4121563880 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab400cbc0 con 0x7fdabc0bce20 2020-11-20T11:50:21.186 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.173+0000 7fdac178c700 1 -- 172.21.15.188:0/4121563880 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc0ae000 con 0x7fdabc0bce20 2020-11-20T11:50:21.186 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.173+0000 7fda9bfff700 1 -- 172.21.15.188:0/4121563880 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab40123f0 con 0x7fdabc0bce20 2020-11-20T11:50:21.186 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.173+0000 7fdac178c700 1 -- 172.21.15.188:0/4121563880 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc0ad9e0 con 0x7fdabc0bce20 2020-11-20T11:50:21.187 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.173+0000 7fda9bfff700 1 -- 172.21.15.188:0/4121563880 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fdab4022070 con 0x7fdabc0bce20 2020-11-20T11:50:21.187 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.173+0000 7fda9bfff700 1 -- 172.21.15.188:0/4121563880 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fdab401ba20 con 0x7fdabc0bce20 2020-11-20T11:50:21.187 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.174+0000 7fdac178c700 1 -- 172.21.15.188:0/4121563880 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc1499d0 con 0x7fdabc0bce20 2020-11-20T11:50:21.187 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.176+0000 7fda9bfff700 1 -- 172.21.15.188:0/4121563880 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fdab403a880 con 0x7fdabc0bce20 2020-11-20T11:50:21.264 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.258+0000 7fdac178c700 1 -- 172.21.15.188:0/4121563880 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "84225f1e-f6bb-4587-994b-0db5e9c2412e", "id": 6} v 0) v1 -- 0x7fdabc1508a0 con 0x7fdabc0bce20 2020-11-20T11:50:21.271 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.261+0000 7fda9bfff700 1 -- 172.21.15.188:0/4121563880 <== mon.2 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84225f1e-f6bb-4587-994b-0db5e9c2412e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdab4029030 con 0x7fdabc0bce20 2020-11-20T11:50:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.262+0000 7fdac178c700 1 -- 172.21.15.188:0/4121563880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 msgr2=0x7fdabc150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.262+0000 7fdac178c700 1 --2- 172.21.15.188:0/4121563880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 0x7fdabc150b80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdab400ed20 tx=0x7fdab4009220).stop 2020-11-20T11:50:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.262+0000 7fdac178c700 1 -- 172.21.15.188:0/4121563880 shutdown_connections 2020-11-20T11:50:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.262+0000 7fdac178c700 1 --2- 172.21.15.188:0/4121563880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc067420 0x7fdabc0ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.272 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.262+0000 7fdac178c700 1 --2- 172.21.15.188:0/4121563880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdabc0bce20 0x7fdabc150b80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.262+0000 7fdac178c700 1 --2- 172.21.15.188:0/4121563880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdabc0bca40 0x7fdabc14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.262+0000 7fdac178c700 1 -- 172.21.15.188:0/4121563880 >> 172.21.15.188:0/4121563880 conn(0x7fdabc0c3230 msgr2=0x7fdabc063e00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.262+0000 7fdac178c700 1 -- 172.21.15.188:0/4121563880 shutdown_connections 2020-11-20T11:50:21.273 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.262+0000 7fdac178c700 1 -- 172.21.15.188:0/4121563880 wait complete. 2020-11-20T11:50:21.273 INFO:teuthology.orchestra.run.smithi188.stdout:6 2020-11-20T11:50:21.279 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 3bbb4a5c-84fe-4339-8b91-a3a26712c5c2 7 2020-11-20T11:50:21.396 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.392+0000 7f39e6ed7700 1 Processor -- start 2020-11-20T11:50:21.397 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.392+0000 7f39e6ed7700 1 -- start start 2020-11-20T11:50:21.399 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.393+0000 7f39e6ed7700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f39e00c4470 0x7f39e00c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.399 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.393+0000 7f39e6ed7700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f39e00bccf0 0x7f39e00c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.400 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.393+0000 7f39e6ed7700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e01555a0 con 0x7f39e00c10e0 2020-11-20T11:50:21.400 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.393+0000 7f39e6ed7700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e01517d0 con 0x7f39e00c4470 2020-11-20T11:50:21.400 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.393+0000 7f39e6ed7700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e0151a70 con 0x7f39e00bccf0 2020-11-20T11:50:21.400 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.393+0000 7f39e5474700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f39e00c10e0 0x7f39e00bf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:51350/0 (socket says 172.21.15.188:51350) 2020-11-20T11:50:21.401 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.393+0000 7f39e5474700 1 -- 172.21.15.188:0/602482343 learned_addr learned my addr 172.21.15.188:0/602482343 (peer_addr_for_me v1:172.21.15.188:0/0) 2020-11-20T11:50:21.401 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39e4c73700 1 --2- 172.21.15.188:0/602482343 >> v2:172.21.15.36:3300/0 conn(0x7f39e00c4470 0x7f39e00c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.401 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39dffff700 1 --2- 172.21.15.188:0/602482343 >> v2:172.21.15.164:3300/0 conn(0x7f39e00bccf0 0x7f39e00c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.402 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39df7fe700 1 -- 172.21.15.188:0/602482343 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635884516 0 0) 0x7f39e01555a0 con 0x7f39e00c10e0 2020-11-20T11:50:21.402 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39df7fe700 1 -- 172.21.15.188:0/602482343 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c0003280 con 0x7f39e00c10e0 2020-11-20T11:50:21.402 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39e4c73700 1 -- 172.21.15.188:0/602482343 >> v2:172.21.15.164:3300/0 conn(0x7f39e00bccf0 msgr2=0x7f39e00c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:21.402 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39e4c73700 1 --2- 172.21.15.188:0/602482343 >> v2:172.21.15.164:3300/0 conn(0x7f39e00bccf0 0x7f39e00c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.402 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39e4c73700 1 -- 172.21.15.188:0/602482343 >> v1:172.21.15.188:6789/0 conn(0x7f39e00c10e0 legacy=0x7f39e00bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.403 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39e4c73700 1 -- 172.21.15.188:0/602482343 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e0151d10 con 0x7f39e00c4470 2020-11-20T11:50:21.403 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39dffff700 1 --2- 172.21.15.188:0/602482343 >> v2:172.21.15.164:3300/0 conn(0x7f39e00bccf0 0x7f39e00c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:21.403 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39e4c73700 1 --2- 172.21.15.188:0/602482343 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f39e00c4470 0x7f39e00c4850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f39e00c4d40 tx=0x7f39d8009220).ready entity=mon.0 client_cookie=f755143807f5985 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:21.403 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39df7fe700 1 -- 172.21.15.188:0/602482343 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d800b9e0 con 0x7f39e00c4470 2020-11-20T11:50:21.403 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39df7fe700 1 -- 172.21.15.188:0/602482343 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d800bb40 con 0x7f39e00c4470 2020-11-20T11:50:21.403 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.394+0000 7f39df7fe700 1 -- 172.21.15.188:0/602482343 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8011400 con 0x7f39e00c4470 2020-11-20T11:50:21.404 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.395+0000 7f39e6ed7700 1 -- 172.21.15.188:0/602482343 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f39e00c4470 msgr2=0x7f39e00c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.404 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.395+0000 7f39e6ed7700 1 --2- 172.21.15.188:0/602482343 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f39e00c4470 0x7f39e00c4850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f39e00c4d40 tx=0x7f39d8009220).stop 2020-11-20T11:50:21.404 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.395+0000 7f39e6ed7700 1 -- 172.21.15.188:0/602482343 shutdown_connections 2020-11-20T11:50:21.404 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.395+0000 7f39e6ed7700 1 --2- 172.21.15.188:0/602482343 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f39e00c4470 0x7f39e00c4850 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.404 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.395+0000 7f39e6ed7700 1 --2- 172.21.15.188:0/602482343 >> v2:172.21.15.164:3300/0 conn(0x7f39e00bccf0 0x7f39e00c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.405 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.395+0000 7f39e6ed7700 1 -- 172.21.15.188:0/602482343 >> 172.21.15.188:0/602482343 conn(0x7f39e00683b0 msgr2=0x7f39e0061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:21.405 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.395+0000 7f39e6ed7700 1 -- 172.21.15.188:0/602482343 shutdown_connections 2020-11-20T11:50:21.405 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.395+0000 7f39e6ed7700 1 -- 172.21.15.188:0/602482343 wait complete. 2020-11-20T11:50:21.407 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.396+0000 7f39e6ed7700 1 Processor -- start 2020-11-20T11:50:21.408 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.396+0000 7f39e6ed7700 1 -- start start 2020-11-20T11:50:21.408 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e6ed7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f39e00bccf0 0x7f39e0156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.408 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e6ed7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39e00c10e0 0x7f39e0155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.408 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e6ed7700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39e00c4470 0x7f39e0152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.409 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e6ed7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e0155f40 con 0x7f39e00bccf0 2020-11-20T11:50:21.409 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e6ed7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e01521d0 con 0x7f39e00c10e0 2020-11-20T11:50:21.409 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e6ed7700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e0156970 con 0x7f39e00c4470 2020-11-20T11:50:21.409 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e5474700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39e00c4470 0x7f39e0152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.409 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e5474700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39e00c4470 0x7f39e0152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43908/0 (socket says 172.21.15.188:43908) 2020-11-20T11:50:21.410 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e5474700 1 -- 172.21.15.188:0/2836523141 learned_addr learned my addr 172.21.15.188:0/2836523141 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:21.410 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e4c73700 1 --2- 172.21.15.188:0/2836523141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f39e00bccf0 0x7f39e0156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.410 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39dffff700 1 --2- 172.21.15.188:0/2836523141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39e00c10e0 0x7f39e0155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.410 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e5474700 1 -- 172.21.15.188:0/2836523141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39e00c10e0 msgr2=0x7f39e0155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.410 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e5474700 1 --2- 172.21.15.188:0/2836523141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39e00c10e0 0x7f39e0155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.411 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e5474700 1 -- 172.21.15.188:0/2836523141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f39e00bccf0 msgr2=0x7f39e0156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.411 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e5474700 1 --2- 172.21.15.188:0/2836523141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f39e00bccf0 0x7f39e0156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.411 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.397+0000 7f39e5474700 1 -- 172.21.15.188:0/2836523141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e0112880 con 0x7f39e00c4470 2020-11-20T11:50:21.411 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.398+0000 7f39e5474700 1 --2- 172.21.15.188:0/2836523141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39e00c4470 0x7f39e0152de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f39c80010e0 tx=0x7f39c8007ae0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:21.411 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.398+0000 7f39dcff9700 1 -- 172.21.15.188:0/2836523141 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80072e0 con 0x7f39e00c4470 2020-11-20T11:50:21.412 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.398+0000 7f39dcff9700 1 -- 172.21.15.188:0/2836523141 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c8007440 con 0x7f39e00c4470 2020-11-20T11:50:21.412 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.398+0000 7f39dcff9700 1 -- 172.21.15.188:0/2836523141 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8005840 con 0x7f39e00c4470 2020-11-20T11:50:21.412 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.398+0000 7f39e6ed7700 1 -- 172.21.15.188:0/2836523141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e0112b20 con 0x7f39e00c4470 2020-11-20T11:50:21.412 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.398+0000 7f39e6ed7700 1 -- 172.21.15.188:0/2836523141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e01526a0 con 0x7f39e00c4470 2020-11-20T11:50:21.412 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.398+0000 7f39dcff9700 1 -- 172.21.15.188:0/2836523141 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f39c8010070 con 0x7f39e00c4470 2020-11-20T11:50:21.413 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.398+0000 7f39dcff9700 1 -- 172.21.15.188:0/2836523141 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f39c801d3f0 con 0x7f39e00c4470 2020-11-20T11:50:21.413 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.399+0000 7f39e6ed7700 1 -- 172.21.15.188:0/2836523141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e0151ef0 con 0x7f39e00c4470 2020-11-20T11:50:21.413 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.401+0000 7f39dcff9700 1 -- 172.21.15.188:0/2836523141 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f39c80138d0 con 0x7f39e00c4470 2020-11-20T11:50:21.485 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.478+0000 7f39e6ed7700 1 -- 172.21.15.188:0/2836523141 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3bbb4a5c-84fe-4339-8b91-a3a26712c5c2", "id": 7} v 0) v1 -- 0x7f39e0155510 con 0x7f39e00c4470 2020-11-20T11:50:21.488 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.482+0000 7f39dcff9700 1 -- 172.21.15.188:0/2836523141 <== mon.2 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3bbb4a5c-84fe-4339-8b91-a3a26712c5c2", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f39c8013a70 con 0x7f39e00c4470 2020-11-20T11:50:21.489 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.483+0000 7f39e6ed7700 1 -- 172.21.15.188:0/2836523141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39e00c4470 msgr2=0x7f39e0152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.490 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.483+0000 7f39e6ed7700 1 --2- 172.21.15.188:0/2836523141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39e00c4470 0x7f39e0152de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f39c80010e0 tx=0x7f39c8007ae0).stop 2020-11-20T11:50:21.492 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.483+0000 7f39e6ed7700 1 -- 172.21.15.188:0/2836523141 shutdown_connections 2020-11-20T11:50:21.492 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.483+0000 7f39e6ed7700 1 --2- 172.21.15.188:0/2836523141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39e00c4470 0x7f39e0152de0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.493 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.483+0000 7f39e6ed7700 1 --2- 172.21.15.188:0/2836523141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f39e00bccf0 0x7f39e0156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.494 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.483+0000 7f39e6ed7700 1 --2- 172.21.15.188:0/2836523141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39e00c10e0 0x7f39e0155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.494 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.483+0000 7f39e6ed7700 1 -- 172.21.15.188:0/2836523141 >> 172.21.15.188:0/2836523141 conn(0x7f39e00683b0 msgr2=0x7f39e0061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:21.495 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.483+0000 7f39e6ed7700 1 -- 172.21.15.188:0/2836523141 shutdown_connections 2020-11-20T11:50:21.495 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.483+0000 7f39e6ed7700 1 -- 172.21.15.188:0/2836523141 wait complete. 2020-11-20T11:50:21.497 INFO:teuthology.orchestra.run.smithi188.stdout:7 2020-11-20T11:50:21.499 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new ca3bb3e9-1e26-4577-8028-e1088664758d 8 2020-11-20T11:50:21.617 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.613+0000 7f6c38923700 1 Processor -- start 2020-11-20T11:50:21.617 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.613+0000 7f6c38923700 1 -- start start 2020-11-20T11:50:21.621 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c38923700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6c34060750 0x7f6c34064740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.622 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c38923700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340bbf30 con 0x7f6c340bd320 2020-11-20T11:50:21.622 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c38923700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340bc1d0 con 0x7f6c34060370 2020-11-20T11:50:21.622 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c38923700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340bc470 con 0x7f6c34060750 2020-11-20T11:50:21.625 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c3259c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6c340bd320 0x7f6c3414db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.188:50434/0 (socket says 172.21.15.188:50434) 2020-11-20T11:50:21.626 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c3259c700 1 -- 172.21.15.188:0/2065281231 learned_addr learned my addr 172.21.15.188:0/2065281231 (peer_addr_for_me v1:172.21.15.188:0/0) 2020-11-20T11:50:21.626 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c3359e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6c34060750 0x7f6c34064740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.626 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c31d9b700 1 -- 172.21.15.188:0/2065281231 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804699882 0 0) 0x7f6c340bbf30 con 0x7f6c340bd320 2020-11-20T11:50:21.627 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c31d9b700 1 -- 172.21.15.188:0/2065281231 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c20003280 con 0x7f6c340bd320 2020-11-20T11:50:21.627 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c3359e700 1 -- 172.21.15.188:0/2065281231 >> v1:172.21.15.164:6789/0 conn(0x7f6c34060370 legacy=0x7f6c34064030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.627 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c31d9b700 1 -- 172.21.15.188:0/2065281231 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103724652 0 0) 0x7f6c340bc1d0 con 0x7f6c34060370 2020-11-20T11:50:21.628 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c3359e700 1 -- 172.21.15.188:0/2065281231 >> v1:172.21.15.36:6789/0 conn(0x7f6c340bd320 legacy=0x7f6c3414db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.628 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c3359e700 1 -- 172.21.15.188:0/2065281231 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c34063650 con 0x7f6c34060750 2020-11-20T11:50:21.628 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.614+0000 7f6c3359e700 1 --2- 172.21.15.188:0/2065281231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c34060750 0x7f6c34064740 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f6c2c009ce0 tx=0x7f6c2c009220).ready entity=mon.1 client_cookie=1a0438c4ae459449 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:21.629 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.615+0000 7f6c31d9b700 1 -- 172.21.15.188:0/2065281231 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00bad0 con 0x7f6c34060750 2020-11-20T11:50:21.629 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.615+0000 7f6c31d9b700 1 -- 172.21.15.188:0/2065281231 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c00bc30 con 0x7f6c34060750 2020-11-20T11:50:21.629 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.615+0000 7f6c31d9b700 1 -- 172.21.15.188:0/2065281231 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c011400 con 0x7f6c34060750 2020-11-20T11:50:21.629 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.615+0000 7f6c38923700 1 -- 172.21.15.188:0/2065281231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c34060750 msgr2=0x7f6c34064740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.630 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.615+0000 7f6c38923700 1 --2- 172.21.15.188:0/2065281231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c34060750 0x7f6c34064740 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f6c2c009ce0 tx=0x7f6c2c009220).stop 2020-11-20T11:50:21.630 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.615+0000 7f6c38923700 1 -- 172.21.15.188:0/2065281231 shutdown_connections 2020-11-20T11:50:21.630 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.615+0000 7f6c38923700 1 --2- 172.21.15.188:0/2065281231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c34060750 0x7f6c34064740 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.631 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.615+0000 7f6c38923700 1 -- 172.21.15.188:0/2065281231 >> 172.21.15.188:0/2065281231 conn(0x7f6c340c3230 msgr2=0x7f6c340c3640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:21.631 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.615+0000 7f6c38923700 1 -- 172.21.15.188:0/2065281231 shutdown_connections 2020-11-20T11:50:21.631 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.615+0000 7f6c38923700 1 -- 172.21.15.188:0/2065281231 wait complete. 2020-11-20T11:50:21.632 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.616+0000 7f6c38923700 1 Processor -- start 2020-11-20T11:50:21.632 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c38923700 1 -- start start 2020-11-20T11:50:21.632 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c38923700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c34060370 0x7f6c340675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.632 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c38923700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c34060750 0x7f6c34142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.633 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c38923700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c340bd320 0x7f6c34143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.633 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c38923700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34143600 con 0x7f6c340bd320 2020-11-20T11:50:21.636 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c38923700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3415e110 con 0x7f6c34060750 2020-11-20T11:50:21.636 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c38923700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3415e3b0 con 0x7f6c34060370 2020-11-20T11:50:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c32d9d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c34060370 0x7f6c340675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c32d9d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c34060370 0x7f6c340675e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43916/0 (socket says 172.21.15.188:43916) 2020-11-20T11:50:21.637 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c32d9d700 1 -- 172.21.15.188:0/847472930 learned_addr learned my addr 172.21.15.188:0/847472930 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:21.638 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c3259c700 1 --2- 172.21.15.188:0/847472930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c34060750 0x7f6c34142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.638 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.617+0000 7f6c3359e700 1 --2- 172.21.15.188:0/847472930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c340bd320 0x7f6c34143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.638 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c3259c700 1 -- 172.21.15.188:0/847472930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c34060370 msgr2=0x7f6c340675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.639 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c3259c700 1 --2- 172.21.15.188:0/847472930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c34060370 0x7f6c340675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.639 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c3259c700 1 -- 172.21.15.188:0/847472930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c340bd320 msgr2=0x7f6c34143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.639 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c3259c700 1 --2- 172.21.15.188:0/847472930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c340bd320 0x7f6c34143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.640 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c3259c700 1 -- 172.21.15.188:0/847472930 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3415e650 con 0x7f6c34060750 2020-11-20T11:50:21.640 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c32d9d700 1 --2- 172.21.15.188:0/847472930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c34060370 0x7f6c340675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:21.640 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c3259c700 1 --2- 172.21.15.188:0/847472930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c34060750 0x7f6c34142c20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6c340bd760 tx=0x7f6c28007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:21.640 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c1affd700 1 -- 172.21.15.188:0/847472930 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280072e0 con 0x7f6c34060750 2020-11-20T11:50:21.641 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c1affd700 1 -- 172.21.15.188:0/847472930 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c28007440 con 0x7f6c34060750 2020-11-20T11:50:21.641 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c38923700 1 -- 172.21.15.188:0/847472930 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3415e8f0 con 0x7f6c34060750 2020-11-20T11:50:21.641 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c1affd700 1 -- 172.21.15.188:0/847472930 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28005860 con 0x7f6c34060750 2020-11-20T11:50:21.642 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c38923700 1 -- 172.21.15.188:0/847472930 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3415de20 con 0x7f6c34060750 2020-11-20T11:50:21.642 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c1affd700 1 -- 172.21.15.188:0/847472930 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f6c28010070 con 0x7f6c34060750 2020-11-20T11:50:21.642 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.618+0000 7f6c1affd700 1 -- 172.21.15.188:0/847472930 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f6c2801d3f0 con 0x7f6c34060750 2020-11-20T11:50:21.643 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.619+0000 7f6c38923700 1 -- 172.21.15.188:0/847472930 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3415ed50 con 0x7f6c34060750 2020-11-20T11:50:21.643 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.623+0000 7f6c1affd700 1 -- 172.21.15.188:0/847472930 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f6c280137e0 con 0x7f6c34060750 2020-11-20T11:50:21.706 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.702+0000 7f6c38923700 1 -- 172.21.15.188:0/847472930 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca3bb3e9-1e26-4577-8028-e1088664758d", "id": 8} v 0) v1 -- 0x7f6c34044fa0 con 0x7f6c34060750 2020-11-20T11:50:21.710 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.706+0000 7f6c1affd700 1 -- 172.21.15.188:0/847472930 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca3bb3e9-1e26-4577-8028-e1088664758d", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6c28013980 con 0x7f6c34060750 2020-11-20T11:50:21.710 INFO:teuthology.orchestra.run.smithi188.stdout:8 2020-11-20T11:50:21.711 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.707+0000 7f6c38923700 1 -- 172.21.15.188:0/847472930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c34060750 msgr2=0x7f6c34142c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.711 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.707+0000 7f6c38923700 1 --2- 172.21.15.188:0/847472930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c34060750 0x7f6c34142c20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6c340bd760 tx=0x7f6c28007a60).stop 2020-11-20T11:50:21.712 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.707+0000 7f6c38923700 1 -- 172.21.15.188:0/847472930 shutdown_connections 2020-11-20T11:50:21.712 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.707+0000 7f6c38923700 1 --2- 172.21.15.188:0/847472930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c340bd320 0x7f6c34143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.712 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.707+0000 7f6c38923700 1 --2- 172.21.15.188:0/847472930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c34060370 0x7f6c340675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.712 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.707+0000 7f6c38923700 1 --2- 172.21.15.188:0/847472930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c34060750 0x7f6c34142c20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.712 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.707+0000 7f6c38923700 1 -- 172.21.15.188:0/847472930 >> 172.21.15.188:0/847472930 conn(0x7f6c340c3230 msgr2=0x7f6c3414ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:21.713 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.707+0000 7f6c38923700 1 -- 172.21.15.188:0/847472930 shutdown_connections 2020-11-20T11:50:21.713 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.707+0000 7f6c38923700 1 -- 172.21.15.188:0/847472930 wait complete. 2020-11-20T11:50:21.723 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new fdb23d21-88fe-4715-8197-4fe0bded6bb4 9 2020-11-20T11:50:21.843 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.839+0000 7fd2e28b6700 1 Processor -- start 2020-11-20T11:50:21.844 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.839+0000 7fd2e28b6700 1 -- start start 2020-11-20T11:50:21.850 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e28b6700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd2dc0650f0 0x7fd2dc062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.851 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e28b6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd2dc151c40 0x7fd2dc067030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.851 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e28b6700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2dc062a60 con 0x7fd2dc064d10 2020-11-20T11:50:21.851 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e28b6700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2dc067520 con 0x7fd2dc151c40 2020-11-20T11:50:21.852 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e28b6700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2dc062520 con 0x7fd2dc0650f0 2020-11-20T11:50:21.852 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e0e53700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd2dc151c40 0x7fd2dc067030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.853 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2db7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd2dc0650f0 0x7fd2dc062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.853 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2dbfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd2dc064d10 0x7fd2dc0baf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.188:50444/0 (socket says 172.21.15.188:50444) 2020-11-20T11:50:21.854 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2db7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd2dc0650f0 0x7fd2dc062ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.188:34286/0 (socket says 172.21.15.188:34286) 2020-11-20T11:50:21.854 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2dbfff700 1 -- 172.21.15.188:0/3392487061 learned_addr learned my addr 172.21.15.188:0/3392487061 (peer_addr_for_me v1:172.21.15.188:0/0) 2020-11-20T11:50:21.854 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e0e53700 1 --2- 172.21.15.188:0/3392487061 >> v2:172.21.15.36:3300/0 conn(0x7fd2dc151c40 0x7fd2dc067030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.188:33588/0 (socket says 172.21.15.188:33588) 2020-11-20T11:50:21.855 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e0e53700 1 -- 172.21.15.188:0/3392487061 >> v2:172.21.15.164:3300/0 conn(0x7fd2dc0650f0 msgr2=0x7fd2dc062ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:21.855 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e0e53700 1 --2- 172.21.15.188:0/3392487061 >> v2:172.21.15.164:3300/0 conn(0x7fd2dc0650f0 0x7fd2dc062ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.856 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e0e53700 1 -- 172.21.15.188:0/3392487061 >> v1:172.21.15.36:6789/0 conn(0x7fd2dc064d10 legacy=0x7fd2dc0baf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.856 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2daffd700 1 -- 172.21.15.188:0/3392487061 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478388693 0 0) 0x7fd2dc062a60 con 0x7fd2dc064d10 2020-11-20T11:50:21.857 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2e0e53700 1 -- 172.21.15.188:0/3392487061 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc1520d0 con 0x7fd2dc151c40 2020-11-20T11:50:21.857 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.840+0000 7fd2db7fe700 1 --2- 172.21.15.188:0/3392487061 >> v2:172.21.15.164:3300/0 conn(0x7fd2dc0650f0 0x7fd2dc062ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:21.857 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2e0e53700 1 --2- 172.21.15.188:0/3392487061 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2dc151c40 0x7fd2dc067030 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd2dc0c2030 tx=0x7fd2d4009220).ready entity=mon.0 client_cookie=64080af807f1c28a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:21.858 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2daffd700 1 -- 172.21.15.188:0/3392487061 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400ba90 con 0x7fd2dc151c40 2020-11-20T11:50:21.858 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2daffd700 1 -- 172.21.15.188:0/3392487061 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400bbf0 con 0x7fd2dc151c40 2020-11-20T11:50:21.858 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2daffd700 1 -- 172.21.15.188:0/3392487061 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4011400 con 0x7fd2dc151c40 2020-11-20T11:50:21.860 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2e28b6700 1 -- 172.21.15.188:0/3392487061 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2dc151c40 msgr2=0x7fd2dc067030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.860 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2e28b6700 1 --2- 172.21.15.188:0/3392487061 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2dc151c40 0x7fd2dc067030 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd2dc0c2030 tx=0x7fd2d4009220).stop 2020-11-20T11:50:21.861 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2e28b6700 1 -- 172.21.15.188:0/3392487061 shutdown_connections 2020-11-20T11:50:21.861 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2e28b6700 1 --2- 172.21.15.188:0/3392487061 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2dc151c40 0x7fd2dc067030 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.861 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2e28b6700 1 --2- 172.21.15.188:0/3392487061 >> v2:172.21.15.164:3300/0 conn(0x7fd2dc0650f0 0x7fd2dc062ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.862 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2e28b6700 1 -- 172.21.15.188:0/3392487061 >> 172.21.15.188:0/3392487061 conn(0x7fd2dc0c55c0 msgr2=0x7fd2dc0c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:21.862 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2e28b6700 1 -- 172.21.15.188:0/3392487061 shutdown_connections 2020-11-20T11:50:21.863 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.841+0000 7fd2e28b6700 1 -- 172.21.15.188:0/3392487061 wait complete. 2020-11-20T11:50:21.863 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.842+0000 7fd2e28b6700 1 Processor -- start 2020-11-20T11:50:21.863 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2e28b6700 1 -- start start 2020-11-20T11:50:21.864 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2e28b6700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2dc064d10 0x7fd2dc114f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.864 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2e28b6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2dc0650f0 0x7fd2dc14c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.865 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2e28b6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2dc151c40 0x7fd2dc154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:21.866 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2e28b6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc14c8f0 con 0x7fd2dc0650f0 2020-11-20T11:50:21.866 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2e28b6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc1158b0 con 0x7fd2dc151c40 2020-11-20T11:50:21.866 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2e28b6700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc0c3570 con 0x7fd2dc064d10 2020-11-20T11:50:21.866 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2dbfff700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2dc064d10 0x7fd2dc114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.867 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2dbfff700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2dc064d10 0x7fd2dc114f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43928/0 (socket says 172.21.15.188:43928) 2020-11-20T11:50:21.867 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2db7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2dc0650f0 0x7fd2dc14c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.867 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2dbfff700 1 -- 172.21.15.188:0/601003809 learned_addr learned my addr 172.21.15.188:0/601003809 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:21.867 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.843+0000 7fd2e0e53700 1 --2- 172.21.15.188:0/601003809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2dc151c40 0x7fd2dc154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:21.867 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2e0e53700 1 -- 172.21.15.188:0/601003809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2dc064d10 msgr2=0x7fd2dc114f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.868 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2e0e53700 1 --2- 172.21.15.188:0/601003809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2dc064d10 0x7fd2dc114f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.868 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2e0e53700 1 -- 172.21.15.188:0/601003809 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2dc0650f0 msgr2=0x7fd2dc14c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.868 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2e0e53700 1 --2- 172.21.15.188:0/601003809 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2dc0650f0 0x7fd2dc14c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.868 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2e0e53700 1 -- 172.21.15.188:0/601003809 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc115610 con 0x7fd2dc151c40 2020-11-20T11:50:21.868 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2dbfff700 1 --2- 172.21.15.188:0/601003809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2dc064d10 0x7fd2dc114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:21.869 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2e0e53700 1 --2- 172.21.15.188:0/601003809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2dc151c40 0x7fd2dc154700 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd2dc0c3070 tx=0x7fd2d4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:21.869 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2bbfff700 1 -- 172.21.15.188:0/601003809 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d401b6b0 con 0x7fd2dc151c40 2020-11-20T11:50:21.869 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2bbfff700 1 -- 172.21.15.188:0/601003809 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d401b810 con 0x7fd2dc151c40 2020-11-20T11:50:21.869 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2e28b6700 1 -- 172.21.15.188:0/601003809 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2dc1601b0 con 0x7fd2dc151c40 2020-11-20T11:50:21.869 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2bbfff700 1 -- 172.21.15.188:0/601003809 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d401bbb0 con 0x7fd2dc151c40 2020-11-20T11:50:21.870 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2e28b6700 1 -- 172.21.15.188:0/601003809 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2dc1606f0 con 0x7fd2dc151c40 2020-11-20T11:50:21.870 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2bbfff700 1 -- 172.21.15.188:0/601003809 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fd2d4017070 con 0x7fd2dc151c40 2020-11-20T11:50:21.870 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.844+0000 7fd2bbfff700 1 -- 172.21.15.188:0/601003809 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1789+0+0 (secure 0 0 0) 0x7fd2d40094c0 con 0x7fd2dc151c40 2020-11-20T11:50:21.870 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.845+0000 7fd2e28b6700 1 -- 172.21.15.188:0/601003809 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2dc069b70 con 0x7fd2dc151c40 2020-11-20T11:50:21.871 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.849+0000 7fd2bbfff700 1 -- 172.21.15.188:0/601003809 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fd2d4015020 con 0x7fd2dc151c40 2020-11-20T11:50:21.931 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.926+0000 7fd2e28b6700 1 -- 172.21.15.188:0/601003809 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fdb23d21-88fe-4715-8197-4fe0bded6bb4", "id": 9} v 0) v1 -- 0x7fd2dc05d590 con 0x7fd2dc151c40 2020-11-20T11:50:21.934 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.930+0000 7fd2bbfff700 1 -- 172.21.15.188:0/601003809 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fdb23d21-88fe-4715-8197-4fe0bded6bb4", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd2d401c860 con 0x7fd2dc151c40 2020-11-20T11:50:21.935 INFO:teuthology.orchestra.run.smithi188.stdout:9 2020-11-20T11:50:21.938 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.931+0000 7fd2e28b6700 1 -- 172.21.15.188:0/601003809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2dc151c40 msgr2=0x7fd2dc154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:21.938 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.931+0000 7fd2e28b6700 1 --2- 172.21.15.188:0/601003809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2dc151c40 0x7fd2dc154700 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd2dc0c3070 tx=0x7fd2d4016000).stop 2020-11-20T11:50:21.939 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.931+0000 7fd2e28b6700 1 -- 172.21.15.188:0/601003809 shutdown_connections 2020-11-20T11:50:21.939 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.931+0000 7fd2e28b6700 1 --2- 172.21.15.188:0/601003809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2dc151c40 0x7fd2dc154700 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.939 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.931+0000 7fd2e28b6700 1 --2- 172.21.15.188:0/601003809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2dc064d10 0x7fd2dc114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.939 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.931+0000 7fd2e28b6700 1 --2- 172.21.15.188:0/601003809 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2dc0650f0 0x7fd2dc14c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:21.939 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.931+0000 7fd2e28b6700 1 -- 172.21.15.188:0/601003809 >> 172.21.15.188:0/601003809 conn(0x7fd2dc0c55c0 msgr2=0x7fd2dc0bffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:21.940 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.931+0000 7fd2e28b6700 1 -- 172.21.15.188:0/601003809 shutdown_connections 2020-11-20T11:50:21.940 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:21.931+0000 7fd2e28b6700 1 -- 172.21.15.188:0/601003809 wait complete. 2020-11-20T11:50:21.946 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 106c212d-2332-4f3a-86d6-212b125e24ac 10 2020-11-20T11:50:22.067 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.062+0000 7fd4a85ed700 1 Processor -- start 2020-11-20T11:50:22.067 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.062+0000 7fd4a85ed700 1 -- start start 2020-11-20T11:50:22.070 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.063+0000 7fd4a85ed700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd4a00c44a0 0x7fd4a00c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.070 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.063+0000 7fd4a85ed700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd4a0068140 0x7fd4a00c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.071 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.063+0000 7fd4a85ed700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a0155070 con 0x7fd4a0151ec0 2020-11-20T11:50:22.071 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.063+0000 7fd4a85ed700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a0155310 con 0x7fd4a0068140 2020-11-20T11:50:22.071 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.063+0000 7fd4a85ed700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a01555b0 con 0x7fd4a00c44a0 2020-11-20T11:50:22.071 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.063+0000 7fd4a5b88700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fd4a0151ec0 0x7fd4a01547a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:51382/0 (socket says 172.21.15.188:51382) 2020-11-20T11:50:22.072 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.063+0000 7fd4a5b88700 1 -- 172.21.15.188:0/2332881241 learned_addr learned my addr 172.21.15.188:0/2332881241 (peer_addr_for_me v1:172.21.15.188:0/0) 2020-11-20T11:50:22.072 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.063+0000 7fd4a6b8a700 1 --2- 172.21.15.188:0/2332881241 >> v2:172.21.15.36:3300/0 conn(0x7fd4a0068140 0x7fd4a00c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.072 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.063+0000 7fd4a6389700 1 --2- 172.21.15.188:0/2332881241 >> v2:172.21.15.164:3300/0 conn(0x7fd4a00c44a0 0x7fd4a00c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.072 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359426230 0 0) 0x7fd4a0155070 con 0x7fd4a0151ec0 2020-11-20T11:50:22.072 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd488003280 con 0x7fd4a0151ec0 2020-11-20T11:50:22.073 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 <== mon.2 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1974099883 0 0) 0x7fd488003280 con 0x7fd4a0151ec0 2020-11-20T11:50:22.073 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 >> v2:172.21.15.164:3300/0 conn(0x7fd4a00c44a0 msgr2=0x7fd4a00c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:22.073 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 --2- 172.21.15.188:0/2332881241 >> v2:172.21.15.164:3300/0 conn(0x7fd4a00c44a0 0x7fd4a00c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.073 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 >> v2:172.21.15.36:3300/0 conn(0x7fd4a0068140 msgr2=0x7fd4a00c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:22.073 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 --2- 172.21.15.188:0/2332881241 >> v2:172.21.15.36:3300/0 conn(0x7fd4a0068140 0x7fd4a00c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.074 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a01514e0 con 0x7fd4a0151ec0 2020-11-20T11:50:22.074 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 <== mon.2 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fd49c001520 con 0x7fd4a0151ec0 2020-11-20T11:50:22.074 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6389700 1 --2- 172.21.15.188:0/2332881241 >> v2:172.21.15.164:3300/0 conn(0x7fd4a00c44a0 0x7fd4a00c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:22.074 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 >> v1:172.21.15.188:6789/0 conn(0x7fd4a0151ec0 legacy=0x7fd4a01547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.075 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4880037c0 0x7fd488003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.075 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd488004520 0x7fd4880049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.075 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd488004e90 0x7fd48800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.075 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a0155310 con 0x7fd488004520 2020-11-20T11:50:22.075 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a01555b0 con 0x7fd488004e90 2020-11-20T11:50:22.075 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd488005340 con 0x7fd4880037c0 2020-11-20T11:50:22.076 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6389700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4880037c0 0x7fd488003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.076 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6b8a700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd488004e90 0x7fd48800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.076 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a5b88700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd488004520 0x7fd4880049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.076 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6389700 1 -- 172.21.15.188:0/2332881241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd488004e90 msgr2=0x7fd48800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:22.076 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6389700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd488004e90 0x7fd48800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.077 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6389700 1 -- 172.21.15.188:0/2332881241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd488004520 msgr2=0x7fd4880049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:22.077 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6389700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd488004520 0x7fd4880049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.077 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6389700 1 -- 172.21.15.188:0/2332881241 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd488003280 con 0x7fd4880037c0 2020-11-20T11:50:22.077 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6b8a700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd488004e90 0x7fd48800b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:22.078 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6b8a700 1 -- 172.21.15.188:0/2332881241 reap_dead start 2020-11-20T11:50:22.078 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.064+0000 7fd4a6389700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4880037c0 0x7fd488003be0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd49000bef0 tx=0x7fd490006e30).ready entity=mon.2 client_cookie=c37e1c6c0b02d43c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:22.081 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.065+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000b5d0 con 0x7fd4880037c0 2020-11-20T11:50:22.081 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.065+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000ed60 con 0x7fd4880037c0 2020-11-20T11:50:22.081 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.065+0000 7fd4a5387700 1 -- 172.21.15.188:0/2332881241 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490012600 con 0x7fd4880037c0 2020-11-20T11:50:22.082 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.065+0000 7fd4a85ed700 1 -- 172.21.15.188:0/2332881241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4880037c0 msgr2=0x7fd488003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.082 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.065+0000 7fd4a85ed700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4880037c0 0x7fd488003be0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd49000bef0 tx=0x7fd490006e30).stop 2020-11-20T11:50:22.082 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.065+0000 7fd4a85ed700 1 -- 172.21.15.188:0/2332881241 shutdown_connections 2020-11-20T11:50:22.082 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.065+0000 7fd4a85ed700 1 --2- 172.21.15.188:0/2332881241 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4880037c0 0x7fd488003be0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.082 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.065+0000 7fd4a85ed700 1 -- 172.21.15.188:0/2332881241 >> 172.21.15.188:0/2332881241 conn(0x7fd4a0061580 msgr2=0x7fd4a00678e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:22.083 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.065+0000 7fd4a85ed700 1 -- 172.21.15.188:0/2332881241 shutdown_connections 2020-11-20T11:50:22.083 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.065+0000 7fd4a85ed700 1 -- 172.21.15.188:0/2332881241 wait complete. 2020-11-20T11:50:22.083 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.066+0000 7fd4a85ed700 1 Processor -- start 2020-11-20T11:50:22.083 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.066+0000 7fd4a85ed700 1 -- start start 2020-11-20T11:50:22.083 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a85ed700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4880037c0 0x7fd4a014ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.084 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a85ed700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4a014f220 0x7fd4a009e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.084 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a85ed700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a0152640 0x7fd4a009eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.084 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a85ed700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a0157cd0 con 0x7fd4a014f220 2020-11-20T11:50:22.084 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a85ed700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a0158b80 con 0x7fd4880037c0 2020-11-20T11:50:22.084 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a85ed700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a009f190 con 0x7fd4a0152640 2020-11-20T11:50:22.085 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6b8a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a0152640 0x7fd4a009eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.085 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6b8a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a0152640 0x7fd4a009eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43950/0 (socket says 172.21.15.188:43950) 2020-11-20T11:50:22.085 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6b8a700 1 -- 172.21.15.188:0/413392194 learned_addr learned my addr 172.21.15.188:0/413392194 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:22.085 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6389700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4880037c0 0x7fd4a014ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.085 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a5b88700 1 --2- 172.21.15.188:0/413392194 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4a014f220 0x7fd4a009e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.086 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6b8a700 1 -- 172.21.15.188:0/413392194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4880037c0 msgr2=0x7fd4a014ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.086 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6b8a700 1 --2- 172.21.15.188:0/413392194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4880037c0 0x7fd4a014ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.086 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6b8a700 1 -- 172.21.15.188:0/413392194 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4a014f220 msgr2=0x7fd4a009e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.086 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6b8a700 1 --2- 172.21.15.188:0/413392194 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4a014f220 0x7fd4a009e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.086 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6b8a700 1 -- 172.21.15.188:0/413392194 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a01614f0 con 0x7fd4a0152640 2020-11-20T11:50:22.087 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6389700 1 --2- 172.21.15.188:0/413392194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4880037c0 0x7fd4a014ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:22.087 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.067+0000 7fd4a6b8a700 1 --2- 172.21.15.188:0/413392194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a0152640 0x7fd4a009eca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd4a00c4040 tx=0x7fd498008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:22.087 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.068+0000 7fd48e7fc700 1 -- 172.21.15.188:0/413392194 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498015690 con 0x7fd4a0152640 2020-11-20T11:50:22.087 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.068+0000 7fd48e7fc700 1 -- 172.21.15.188:0/413392194 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980157f0 con 0x7fd4a0152640 2020-11-20T11:50:22.087 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.068+0000 7fd4a85ed700 1 -- 172.21.15.188:0/413392194 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a0157f00 con 0x7fd4a0152640 2020-11-20T11:50:22.088 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.068+0000 7fd48e7fc700 1 -- 172.21.15.188:0/413392194 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498015b90 con 0x7fd4a0152640 2020-11-20T11:50:22.088 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.068+0000 7fd4a85ed700 1 -- 172.21.15.188:0/413392194 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a0158440 con 0x7fd4a0152640 2020-11-20T11:50:22.088 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.068+0000 7fd48e7fc700 1 -- 172.21.15.188:0/413392194 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fd49801e030 con 0x7fd4a0152640 2020-11-20T11:50:22.089 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.068+0000 7fd48e7fc700 1 -- 172.21.15.188:0/413392194 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1904+0+0 (secure 0 0 0) 0x7fd498013bf0 con 0x7fd4a0152640 2020-11-20T11:50:22.090 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.069+0000 7fd4a85ed700 1 -- 172.21.15.188:0/413392194 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a0151d00 con 0x7fd4a0152640 2020-11-20T11:50:22.090 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.071+0000 7fd48e7fc700 1 -- 172.21.15.188:0/413392194 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fd49801c070 con 0x7fd4a0152640 2020-11-20T11:50:22.090 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.086+0000 7fd48e7fc700 1 -- 172.21.15.188:0/413392194 <== mon.2 v2:172.21.15.188:3300/0 7 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7fd498012040 con 0x7fd4a0152640 2020-11-20T11:50:22.158 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.152+0000 7fd4a85ed700 1 -- 172.21.15.188:0/413392194 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "106c212d-2332-4f3a-86d6-212b125e24ac", "id": 10} v 0) v1 -- 0x7fd4a00be700 con 0x7fd4a0152640 2020-11-20T11:50:22.161 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.157+0000 7fd48e7fc700 1 -- 172.21.15.188:0/413392194 <== mon.2 v2:172.21.15.188:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "106c212d-2332-4f3a-86d6-212b125e24ac", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7fd498027890 con 0x7fd4a0152640 2020-11-20T11:50:22.161 INFO:teuthology.orchestra.run.smithi188.stdout:10 2020-11-20T11:50:22.162 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.157+0000 7fd4a85ed700 1 -- 172.21.15.188:0/413392194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a0152640 msgr2=0x7fd4a009eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.162 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.157+0000 7fd4a85ed700 1 --2- 172.21.15.188:0/413392194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a0152640 0x7fd4a009eca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd4a00c4040 tx=0x7fd498008040).stop 2020-11-20T11:50:22.162 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.158+0000 7fd4a85ed700 1 -- 172.21.15.188:0/413392194 shutdown_connections 2020-11-20T11:50:22.163 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.158+0000 7fd4a85ed700 1 --2- 172.21.15.188:0/413392194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4880037c0 0x7fd4a014ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.163 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.158+0000 7fd4a85ed700 1 --2- 172.21.15.188:0/413392194 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a0152640 0x7fd4a009eca0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.163 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.158+0000 7fd4a85ed700 1 --2- 172.21.15.188:0/413392194 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4a014f220 0x7fd4a009e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.163 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.158+0000 7fd4a85ed700 1 -- 172.21.15.188:0/413392194 >> 172.21.15.188:0/413392194 conn(0x7fd4a0061580 msgr2=0x7fd4a00c5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:22.163 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.158+0000 7fd4a85ed700 1 -- 172.21.15.188:0/413392194 shutdown_connections 2020-11-20T11:50:22.164 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.158+0000 7fd4a85ed700 1 -- 172.21.15.188:0/413392194 wait complete. 2020-11-20T11:50:22.173 INFO:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 428273c5-731b-4472-98e6-62b48a587419 11 2020-11-20T11:50:22.285 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.281+0000 7f9b4d183700 1 Processor -- start 2020-11-20T11:50:22.285 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.281+0000 7f9b4d183700 1 -- start start 2020-11-20T11:50:22.287 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9b480bf590 0x7f9b48064240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.288 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b48155240 con 0x7f9b480c0ec0 2020-11-20T11:50:22.288 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b481511a0 con 0x7f9b480c12a0 2020-11-20T11:50:22.288 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b480c1750 con 0x7f9b480bf590 2020-11-20T11:50:22.288 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4659c700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9b480bf590 0x7f9b48064240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.288 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4759e700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f9b480c12a0 0x7f9b48154580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:51404/0 (socket says 172.21.15.188:51404) 2020-11-20T11:50:22.289 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4759e700 1 -- 172.21.15.188:0/3556144797 learned_addr learned my addr 172.21.15.188:0/3556144797 (peer_addr_for_me v1:172.21.15.188:0/0) 2020-11-20T11:50:22.289 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4659c700 1 -- 172.21.15.188:0/3556144797 >> v1:172.21.15.188:6789/0 conn(0x7f9b480c12a0 legacy=0x7f9b48154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.289 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4659c700 1 -- 172.21.15.188:0/3556144797 >> v1:172.21.15.36:6789/0 conn(0x7f9b480c0ec0 legacy=0x7f9b480bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.289 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b45d9b700 1 -- 172.21.15.188:0/3556144797 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104811142 0 0) 0x7f9b481511a0 con 0x7f9b480c12a0 2020-11-20T11:50:22.289 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4659c700 1 -- 172.21.15.188:0/3556144797 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b48151440 con 0x7f9b480bf590 2020-11-20T11:50:22.290 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4659c700 1 --2- 172.21.15.188:0/3556144797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 0x7f9b48064240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9b3c006fd0 tx=0x7f9b3c006e30).ready entity=mon.2 client_cookie=2184bdc99d7d9e6d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:22.290 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b45d9b700 1 -- 172.21.15.188:0/3556144797 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c009870 con 0x7f9b480bf590 2020-11-20T11:50:22.290 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b45d9b700 1 -- 172.21.15.188:0/3556144797 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c000e90 con 0x7f9b480bf590 2020-11-20T11:50:22.290 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b45d9b700 1 -- 172.21.15.188:0/3556144797 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c009be0 con 0x7f9b480bf590 2020-11-20T11:50:22.290 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 -- 172.21.15.188:0/3556144797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 msgr2=0x7f9b48064240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.291 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 --2- 172.21.15.188:0/3556144797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 0x7f9b48064240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9b3c006fd0 tx=0x7f9b3c006e30).stop 2020-11-20T11:50:22.291 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 -- 172.21.15.188:0/3556144797 shutdown_connections 2020-11-20T11:50:22.291 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 --2- 172.21.15.188:0/3556144797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 0x7f9b48064240 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.291 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 -- 172.21.15.188:0/3556144797 >> 172.21.15.188:0/3556144797 conn(0x7f9b480612c0 msgr2=0x7f9b480616d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:22.291 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 -- 172.21.15.188:0/3556144797 shutdown_connections 2020-11-20T11:50:22.292 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.283+0000 7f9b4d183700 1 -- 172.21.15.188:0/3556144797 wait complete. 2020-11-20T11:50:22.294 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.284+0000 7f9b4d183700 1 Processor -- start 2020-11-20T11:50:22.294 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.284+0000 7f9b4d183700 1 -- start start 2020-11-20T11:50:22.294 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b4d183700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 0x7f9b48164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.295 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b4d183700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b480c0ec0 0x7f9b48154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.295 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b4d183700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b480c12a0 0x7f9b480bbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:22.295 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b4d183700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b48164b80 con 0x7f9b480c12a0 2020-11-20T11:50:22.295 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b4d183700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b48152f00 con 0x7f9b480c0ec0 2020-11-20T11:50:22.295 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b4d183700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b481531a0 con 0x7f9b480bf590 2020-11-20T11:50:22.296 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b46d9d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 0x7f9b48164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.296 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b46d9d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 0x7f9b48164690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43958/0 (socket says 172.21.15.188:43958) 2020-11-20T11:50:22.296 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b46d9d700 1 -- 172.21.15.188:0/913309365 learned_addr learned my addr 172.21.15.188:0/913309365 (peer_addr_for_me v2:172.21.15.188:0/0) 2020-11-20T11:50:22.296 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b4759e700 1 --2- 172.21.15.188:0/913309365 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b480c12a0 0x7f9b480bbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:22.296 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b46d9d700 1 -- 172.21.15.188:0/913309365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b480c0ec0 msgr2=0x7f9b48154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.297 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b46d9d700 1 --2- 172.21.15.188:0/913309365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b480c0ec0 0x7f9b48154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:22.297 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b46d9d700 1 -- 172.21.15.188:0/913309365 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b480c12a0 msgr2=0x7f9b480bbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.297 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b46d9d700 1 --2- 172.21.15.188:0/913309365 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b480c12a0 0x7f9b480bbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.297 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b46d9d700 1 -- 172.21.15.188:0/913309365 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b48153440 con 0x7f9b480bf590 2020-11-20T11:50:22.297 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b46d9d700 1 --2- 172.21.15.188:0/913309365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 0x7f9b48164690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9b3800c710 tx=0x7f9b38007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:22.298 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b2effd700 1 -- 172.21.15.188:0/913309365 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38007020 con 0x7f9b480bf590 2020-11-20T11:50:22.298 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b2effd700 1 -- 172.21.15.188:0/913309365 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b38001e90 con 0x7f9b480bf590 2020-11-20T11:50:22.298 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b4d183700 1 -- 172.21.15.188:0/913309365 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b481536e0 con 0x7f9b480bf590 2020-11-20T11:50:22.298 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b2effd700 1 -- 172.21.15.188:0/913309365 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b380073b0 con 0x7f9b480bf590 2020-11-20T11:50:22.298 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b4d183700 1 -- 172.21.15.188:0/913309365 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b48153c20 con 0x7f9b480bf590 2020-11-20T11:50:22.299 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b2effd700 1 -- 172.21.15.188:0/913309365 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7f9b38010070 con 0x7f9b480bf590 2020-11-20T11:50:22.299 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b2effd700 1 -- 172.21.15.188:0/913309365 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2395+0+0 (secure 0 0 0) 0x7f9b3803c020 con 0x7f9b480bf590 2020-11-20T11:50:22.299 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.286+0000 7f9b2cff9700 1 -- 172.21.15.188:0/913309365 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b18004fd0 con 0x7f9b480bf590 2020-11-20T11:50:22.299 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.289+0000 7f9b2effd700 1 -- 172.21.15.188:0/913309365 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f9b38019900 con 0x7f9b480bf590 2020-11-20T11:50:22.366 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.362+0000 7f9b2cff9700 1 -- 172.21.15.188:0/913309365 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "428273c5-731b-4472-98e6-62b48a587419", "id": 11} v 0) v1 -- 0x7f9b18004070 con 0x7f9b480bf590 2020-11-20T11:50:22.370 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.366+0000 7f9b2effd700 1 -- 172.21.15.188:0/913309365 <== mon.2 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "428273c5-731b-4472-98e6-62b48a587419", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7f9b380390b0 con 0x7f9b480bf590 2020-11-20T11:50:22.370 INFO:teuthology.orchestra.run.smithi188.stdout:11 2020-11-20T11:50:22.371 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.367+0000 7f9b2cff9700 1 -- 172.21.15.188:0/913309365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 msgr2=0x7f9b48164690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:22.372 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.367+0000 7f9b2cff9700 1 --2- 172.21.15.188:0/913309365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 0x7f9b48164690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9b3800c710 tx=0x7f9b38007c90).stop 2020-11-20T11:50:22.372 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.367+0000 7f9b2cff9700 1 -- 172.21.15.188:0/913309365 shutdown_connections 2020-11-20T11:50:22.372 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.367+0000 7f9b2cff9700 1 --2- 172.21.15.188:0/913309365 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b480c12a0 0x7f9b480bbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.372 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.367+0000 7f9b2cff9700 1 --2- 172.21.15.188:0/913309365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b480bf590 0x7f9b48164690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:22.373 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.367+0000 7f9b2cff9700 1 --2- 172.21.15.188:0/913309365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b480c0ec0 0x7f9b48154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:22.373 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.367+0000 7f9b2cff9700 1 -- 172.21.15.188:0/913309365 >> 172.21.15.188:0/913309365 conn(0x7f9b480612c0 msgr2=0x7f9b480bee80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:22.373 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.367+0000 7f9b2cff9700 1 -- 172.21.15.188:0/913309365 shutdown_connections 2020-11-20T11:50:22.373 INFO:teuthology.orchestra.run.smithi188.stderr:2020-11-20T11:50:22.367+0000 7f9b2cff9700 1 -- 172.21.15.188:0/913309365 wait complete. 2020-11-20T11:50:22.382 INFO:tasks.ceph.osd.0:Restarting daemon 2020-11-20T11:50:22.383 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-11-20T11:50:22.388 INFO:tasks.ceph.osd.0:Started 2020-11-20T11:50:22.388 INFO:tasks.ceph.osd.3:Restarting daemon 2020-11-20T11:50:22.389 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-11-20T11:50:22.393 INFO:tasks.ceph.osd.3:Started 2020-11-20T11:50:22.393 INFO:tasks.ceph.osd.6:Restarting daemon 2020-11-20T11:50:22.394 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-11-20T11:50:22.397 INFO:tasks.ceph.osd.6:Started 2020-11-20T11:50:22.398 INFO:tasks.ceph.osd.9:Restarting daemon 2020-11-20T11:50:22.398 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2020-11-20T11:50:22.401 INFO:tasks.ceph.osd.9:Started 2020-11-20T11:50:22.401 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-20T11:50:22.401 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-20T11:50:22.404 INFO:tasks.ceph.osd.1:Started 2020-11-20T11:50:22.404 INFO:tasks.ceph.osd.4:Restarting daemon 2020-11-20T11:50:22.405 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-11-20T11:50:22.407 INFO:tasks.ceph.osd.4:Started 2020-11-20T11:50:22.407 INFO:tasks.ceph.osd.7:Restarting daemon 2020-11-20T11:50:22.408 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-11-20T11:50:22.410 INFO:tasks.ceph.osd.7:Started 2020-11-20T11:50:22.410 INFO:tasks.ceph.osd.10:Restarting daemon 2020-11-20T11:50:22.411 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2020-11-20T11:50:22.414 INFO:tasks.ceph.osd.10:Started 2020-11-20T11:50:22.414 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-20T11:50:22.415 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-20T11:50:22.420 INFO:tasks.ceph.osd.2:Started 2020-11-20T11:50:22.420 INFO:tasks.ceph.osd.5:Restarting daemon 2020-11-20T11:50:22.421 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-11-20T11:50:22.423 INFO:tasks.ceph.osd.5:Started 2020-11-20T11:50:22.423 INFO:tasks.ceph.osd.8:Restarting daemon 2020-11-20T11:50:22.424 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2020-11-20T11:50:22.426 INFO:tasks.ceph.osd.8:Started 2020-11-20T11:50:22.427 INFO:tasks.ceph.osd.11:Restarting daemon 2020-11-20T11:50:22.427 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2020-11-20T11:50:22.430 INFO:tasks.ceph.osd.11:Started 2020-11-20T11:50:22.430 INFO:tasks.ceph:Waiting for OSDs to come up 2020-11-20T11:50:22.978 INFO:tasks.ceph.osd.0.smithi164.stderr:2020-11-20T11:50:22.975+0000 7fe4b75e4f40 -1 Falling back to public interface 2020-11-20T11:50:22.983 INFO:tasks.ceph.osd.3.smithi164.stderr:2020-11-20T11:50:22.980+0000 7f41b89b3f40 -1 Falling back to public interface 2020-11-20T11:50:22.984 INFO:tasks.ceph.osd.6.smithi164.stderr:2020-11-20T11:50:22.981+0000 7f8f9425bf40 -1 Falling back to public interface 2020-11-20T11:50:22.993 INFO:tasks.ceph.osd.9.smithi164.stderr:2020-11-20T11:50:22.990+0000 7f5335eccf40 -1 Falling back to public interface 2020-11-20T11:50:22.998 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-20T11:50:22.995+0000 7fa97910df40 -1 Falling back to public interface 2020-11-20T11:50:23.004 INFO:tasks.ceph.osd.7.smithi036.stderr:2020-11-20T11:50:23.001+0000 7f0de0616f40 -1 Falling back to public interface 2020-11-20T11:50:23.008 INFO:tasks.ceph.osd.10.smithi036.stderr:2020-11-20T11:50:23.005+0000 7fa574a25f40 -1 Falling back to public interface 2020-11-20T11:50:23.009 INFO:tasks.ceph.osd.2.smithi188.stderr:2020-11-20T11:50:23.005+0000 7fa43e722f40 -1 Falling back to public interface 2020-11-20T11:50:23.015 INFO:tasks.ceph.osd.5.smithi188.stderr:2020-11-20T11:50:23.012+0000 7f83f701af40 -1 Falling back to public interface 2020-11-20T11:50:23.019 INFO:tasks.ceph.osd.11.smithi188.stderr:2020-11-20T11:50:23.016+0000 7faeff4e8f40 -1 Falling back to public interface 2020-11-20T11:50:23.057 INFO:tasks.ceph.osd.8.smithi188.stderr:2020-11-20T11:50:23.054+0000 7f7687816f40 -1 Falling back to public interface 2020-11-20T11:50:23.058 INFO:tasks.ceph.osd.4.smithi036.stderr:2020-11-20T11:50:23.055+0000 7f8c4a305f40 -1 Falling back to public interface 2020-11-20T11:50:23.640 INFO:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:23.749 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.746+0000 7fdc532f6700 1 Processor -- start 2020-11-20T11:50:24.180 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.746+0000 7fdc532f6700 1 -- start start 2020-11-20T11:50:24.188 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:24.188 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.747+0000 7fdc532f6700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdc4c060370 0x7fdc4c060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:24.189 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.747+0000 7fdc532f6700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c150ef0 con 0x7fdc4c150350 2020-11-20T11:50:24.189 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.747+0000 7fdc532f6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c151180 con 0x7fdc4c065ce0 2020-11-20T11:50:24.189 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.747+0000 7fdc532f6700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c151420 con 0x7fdc4c060370 2020-11-20T11:50:24.189 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.747+0000 7fdc50891700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fdc4c065ce0 0x7fdc4c0bb2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:54494/0 (socket says 172.21.15.164:54494) 2020-11-20T11:50:24.189 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.747+0000 7fdc50891700 1 -- 172.21.15.164:0/913588873 learned_addr learned my addr 172.21.15.164:0/913588873 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:24.190 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.747+0000 7fdc51092700 1 --2- 172.21.15.164:0/913588873 >> v2:172.21.15.188:3300/0 conn(0x7fdc4c060370 0x7fdc4c060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:24.190 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.747+0000 7fdc3bfff700 1 -- 172.21.15.164:0/913588873 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146389679 0 0) 0x7fdc4c151180 con 0x7fdc4c065ce0 2020-11-20T11:50:24.190 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc3bfff700 1 -- 172.21.15.164:0/913588873 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc34003280 con 0x7fdc4c065ce0 2020-11-20T11:50:24.190 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc3bfff700 1 -- 172.21.15.164:0/913588873 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654146566 0 0) 0x7fdc4c150ef0 con 0x7fdc4c150350 2020-11-20T11:50:24.190 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc3bfff700 1 -- 172.21.15.164:0/913588873 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc4c151180 con 0x7fdc4c150350 2020-11-20T11:50:24.191 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc3bfff700 1 -- 172.21.15.164:0/913588873 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 438515823 0 0) 0x7fdc34003280 con 0x7fdc4c065ce0 2020-11-20T11:50:24.191 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc51092700 1 -- 172.21.15.164:0/913588873 >> v1:172.21.15.164:6789/0 conn(0x7fdc4c065ce0 legacy=0x7fdc4c0bb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:24.191 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc51092700 1 -- 172.21.15.164:0/913588873 >> v1:172.21.15.36:6789/0 conn(0x7fdc4c150350 legacy=0x7fdc4c1507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:24.191 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc51092700 1 -- 172.21.15.164:0/913588873 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c1516c0 con 0x7fdc4c060370 2020-11-20T11:50:24.191 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc51092700 1 --2- 172.21.15.164:0/913588873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc4c060370 0x7fdc4c060750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fdc48006fd0 tx=0x7fdc48006e30).ready entity=mon.2 client_cookie=74a4c87e0a3c2e50 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:24.192 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc3bfff700 1 -- 172.21.15.164:0/913588873 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c001520 con 0x7fdc4c060370 2020-11-20T11:50:24.192 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc3bfff700 1 -- 172.21.15.164:0/913588873 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc48000e90 con 0x7fdc4c060370 2020-11-20T11:50:24.192 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc3bfff700 1 -- 172.21.15.164:0/913588873 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48011610 con 0x7fdc4c060370 2020-11-20T11:50:24.192 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc532f6700 1 -- 172.21.15.164:0/913588873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc4c060370 msgr2=0x7fdc4c060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:24.192 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc532f6700 1 --2- 172.21.15.164:0/913588873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc4c060370 0x7fdc4c060750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fdc48006fd0 tx=0x7fdc48006e30).stop 2020-11-20T11:50:24.193 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc532f6700 1 -- 172.21.15.164:0/913588873 shutdown_connections 2020-11-20T11:50:24.193 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc532f6700 1 --2- 172.21.15.164:0/913588873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc4c060370 0x7fdc4c060750 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:24.193 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.748+0000 7fdc532f6700 1 -- 172.21.15.164:0/913588873 >> 172.21.15.164:0/913588873 conn(0x7fdc4c061d30 msgr2=0x7fdc4c0c44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:24.193 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.749+0000 7fdc532f6700 1 -- 172.21.15.164:0/913588873 shutdown_connections 2020-11-20T11:50:24.193 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.749+0000 7fdc532f6700 1 -- 172.21.15.164:0/913588873 wait complete. 2020-11-20T11:50:24.194 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.750+0000 7fdc532f6700 1 Processor -- start 2020-11-20T11:50:24.194 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.750+0000 7fdc532f6700 1 -- start start 2020-11-20T11:50:24.194 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc532f6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc4c060370 0x7fdc4c0bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:24.194 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc532f6700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc4c065ce0 0x7fdc4c1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:24.194 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc532f6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc4c150350 0x7fdc4c154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:24.195 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc532f6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c163a30 con 0x7fdc4c150350 2020-11-20T11:50:24.196 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc532f6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c163cd0 con 0x7fdc4c060370 2020-11-20T11:50:24.196 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc532f6700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c163f70 con 0x7fdc4c065ce0 2020-11-20T11:50:24.197 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51092700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc4c060370 0x7fdc4c0bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:24.197 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51092700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc4c060370 0x7fdc4c0bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44760/0 (socket says 172.21.15.164:44760) 2020-11-20T11:50:24.197 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51092700 1 -- 172.21.15.164:0/2632281627 learned_addr learned my addr 172.21.15.164:0/2632281627 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:24.197 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51893700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc4c150350 0x7fdc4c154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:24.197 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc50891700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc4c065ce0 0x7fdc4c1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:24.198 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51092700 1 -- 172.21.15.164:0/2632281627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc4c065ce0 msgr2=0x7fdc4c1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:24.198 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51092700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc4c065ce0 0x7fdc4c1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:24.198 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51092700 1 -- 172.21.15.164:0/2632281627 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc4c150350 msgr2=0x7fdc4c154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:24.198 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51092700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc4c150350 0x7fdc4c154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:24.199 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51092700 1 -- 172.21.15.164:0/2632281627 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c164210 con 0x7fdc4c060370 2020-11-20T11:50:24.199 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51893700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc4c150350 0x7fdc4c154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:24.199 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc51092700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc4c060370 0x7fdc4c0bf0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fdc4c067330 tx=0x7fdc48015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:24.199 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc397fa700 1 -- 172.21.15.164:0/2632281627 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48010bc0 con 0x7fdc4c060370 2020-11-20T11:50:24.199 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc397fa700 1 -- 172.21.15.164:0/2632281627 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc48010d20 con 0x7fdc4c060370 2020-11-20T11:50:24.200 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc532f6700 1 -- 172.21.15.164:0/2632281627 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c1644b0 con 0x7fdc4c060370 2020-11-20T11:50:24.200 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc397fa700 1 -- 172.21.15.164:0/2632281627 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4801d5d0 con 0x7fdc4c060370 2020-11-20T11:50:24.200 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.751+0000 7fdc532f6700 1 -- 172.21.15.164:0/2632281627 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c154f90 con 0x7fdc4c060370 2020-11-20T11:50:24.200 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.752+0000 7fdc532f6700 1 -- 172.21.15.164:0/2632281627 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4c155180 con 0x7fdc4c060370 2020-11-20T11:50:24.200 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.753+0000 7fdc397fa700 1 -- 172.21.15.164:0/2632281627 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 3) v1 ==== 101030+0+0 (secure 0 0 0) 0x7fdc48026030 con 0x7fdc4c060370 2020-11-20T11:50:24.200 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.753+0000 7fdc397fa700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fdc24080590 0x7fdc24082a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:24.201 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.753+0000 7fdc397fa700 1 -- 172.21.15.164:0/2632281627 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2534+0+0 (secure 0 0 0) 0x7fdc480a2730 con 0x7fdc4c060370 2020-11-20T11:50:24.201 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.753+0000 7fdc50891700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fdc24080590 0x7fdc24082a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:24.201 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.754+0000 7fdc50891700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fdc24080590 0x7fdc24082a50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fdc3c000fb0 tx=0x7fdc3c0015d0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:24.201 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.757+0000 7fdc397fa700 1 -- 172.21.15.164:0/2632281627 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fdc4c155180 con 0x7fdc4c060370 2020-11-20T11:50:24.202 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.900+0000 7fdc532f6700 1 -- 172.21.15.164:0/2632281627 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc4c155180 con 0x7fdc4c060370 2020-11-20T11:50:24.202 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.901+0000 7fdc397fa700 1 -- 172.21.15.164:0/2632281627 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11483 (secure 0 0 0) 0x7fdc4c155180 con 0x7fdc4c060370 2020-11-20T11:50:24.202 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 -- 172.21.15.164:0/2632281627 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fdc24080590 msgr2=0x7fdc24082a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:24.202 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fdc24080590 0x7fdc24082a50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fdc3c000fb0 tx=0x7fdc3c0015d0).stop 2020-11-20T11:50:24.202 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 -- 172.21.15.164:0/2632281627 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc4c060370 msgr2=0x7fdc4c0bf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:24.203 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc4c060370 0x7fdc4c0bf0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fdc4c067330 tx=0x7fdc48015000).stop 2020-11-20T11:50:24.203 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 -- 172.21.15.164:0/2632281627 shutdown_connections 2020-11-20T11:50:24.203 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fdc24080590 0x7fdc24082a50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:24.203 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc4c060370 0x7fdc4c0bf0c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:24.203 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc4c150350 0x7fdc4c154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:24.204 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 --2- 172.21.15.164:0/2632281627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc4c065ce0 0x7fdc4c1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:24.204 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 -- 172.21.15.164:0/2632281627 >> 172.21.15.164:0/2632281627 conn(0x7fdc4c061d30 msgr2=0x7fdc4c063970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:24.204 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.902+0000 7fdc532f6700 1 -- 172.21.15.164:0/2632281627 shutdown_connections 2020-11-20T11:50:24.204 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:23.903+0000 7fdc532f6700 1 -- 172.21.15.164:0/2632281627 wait complete. 2020-11-20T11:50:24.204 INFO:teuthology.misc.health.smithi164.stdout: 2020-11-20T11:50:24.205 INFO:teuthology.misc.health.smithi164.stdout:{"epoch":14,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:22.365352+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:24.205 DEBUG:teuthology.misc:0 of 12 OSDs are up 2020-11-20T11:50:24.208 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:24.210 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:24.305 INFO:tasks.ceph.osd.0.smithi164.stderr:2020-11-20T11:50:24.302+0000 7fe4b75e4f40 -1 osd.0 0 log_to_monitors {default=true} 2020-11-20T11:50:24.319 INFO:tasks.ceph.osd.6.smithi164.stderr:2020-11-20T11:50:24.314+0000 7f8f9425bf40 -1 osd.6 0 log_to_monitors {default=true} 2020-11-20T11:50:24.326 INFO:tasks.ceph.osd.3.smithi164.stderr:2020-11-20T11:50:24.323+0000 7f41b89b3f40 -1 osd.3 0 log_to_monitors {default=true} 2020-11-20T11:50:24.334 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-20T11:50:24.332+0000 7fa97910df40 -1 osd.1 0 log_to_monitors {default=true} 2020-11-20T11:50:24.337 INFO:tasks.ceph.osd.9.smithi164.stderr:2020-11-20T11:50:24.334+0000 7f5335eccf40 -1 osd.9 0 log_to_monitors {default=true} 2020-11-20T11:50:24.339 INFO:tasks.ceph.osd.2.smithi188.stderr:2020-11-20T11:50:24.336+0000 7fa43e722f40 -1 osd.2 0 log_to_monitors {default=true} 2020-11-20T11:50:24.355 INFO:tasks.ceph.osd.7.smithi036.stderr:2020-11-20T11:50:24.352+0000 7f0de0616f40 -1 osd.7 0 log_to_monitors {default=true} 2020-11-20T11:50:24.356 INFO:tasks.ceph.osd.10.smithi036.stderr:2020-11-20T11:50:24.352+0000 7fa574a25f40 -1 osd.10 0 log_to_monitors {default=true} 2020-11-20T11:50:24.357 INFO:tasks.ceph.osd.5.smithi188.stderr:2020-11-20T11:50:24.352+0000 7f83f701af40 -1 osd.5 0 log_to_monitors {default=true} 2020-11-20T11:50:24.358 INFO:tasks.ceph.osd.11.smithi188.stderr:2020-11-20T11:50:24.355+0000 7faeff4e8f40 -1 osd.11 0 log_to_monitors {default=true} 2020-11-20T11:50:24.400 INFO:tasks.ceph.osd.4.smithi036.stderr:2020-11-20T11:50:24.397+0000 7f8c4a305f40 -1 osd.4 0 log_to_monitors {default=true} 2020-11-20T11:50:24.401 INFO:tasks.ceph.osd.8.smithi188.stderr:2020-11-20T11:50:24.398+0000 7f7687816f40 -1 osd.8 0 log_to_monitors {default=true} 2020-11-20T11:50:26.110 INFO:tasks.ceph.osd.7.smithi036.stderr:2020-11-20T11:50:26.107+0000 7f0dd6d9f700 -1 osd.7 0 waiting for initial osdmap 2020-11-20T11:50:26.110 INFO:tasks.ceph.osd.2.smithi188.stderr:2020-11-20T11:50:26.106+0000 7fa434eab700 -1 osd.2 0 waiting for initial osdmap 2020-11-20T11:50:26.117 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-20T11:50:26.112+0000 7fa96f896700 -1 osd.1 0 waiting for initial osdmap 2020-11-20T11:50:26.118 INFO:tasks.ceph.osd.6.smithi164.stderr:2020-11-20T11:50:26.112+0000 7f8f8a9e4700 -1 osd.6 0 waiting for initial osdmap 2020-11-20T11:50:26.119 INFO:tasks.ceph.osd.3.smithi164.stderr:2020-11-20T11:50:26.112+0000 7f41af13c700 -1 osd.3 0 waiting for initial osdmap 2020-11-20T11:50:26.120 INFO:tasks.ceph.osd.9.smithi164.stderr:2020-11-20T11:50:26.111+0000 7f532c655700 -1 osd.9 0 waiting for initial osdmap 2020-11-20T11:50:26.122 INFO:tasks.ceph.osd.5.smithi188.stderr:2020-11-20T11:50:26.113+0000 7f83ed7a3700 -1 osd.5 0 waiting for initial osdmap 2020-11-20T11:50:26.122 INFO:tasks.ceph.osd.11.smithi188.stderr:2020-11-20T11:50:26.114+0000 7faef5c71700 -1 osd.11 0 waiting for initial osdmap 2020-11-20T11:50:26.123 INFO:tasks.ceph.osd.8.smithi188.stderr:2020-11-20T11:50:26.115+0000 7f767df9f700 -1 osd.8 0 waiting for initial osdmap 2020-11-20T11:50:26.123 INFO:tasks.ceph.osd.10.smithi036.stderr:2020-11-20T11:50:26.113+0000 7fa56b1ae700 -1 osd.10 0 waiting for initial osdmap 2020-11-20T11:50:26.123 INFO:tasks.ceph.osd.4.smithi036.stderr:2020-11-20T11:50:26.114+0000 7f8c40a8e700 -1 osd.4 0 waiting for initial osdmap 2020-11-20T11:50:26.123 INFO:tasks.ceph.osd.0.smithi164.stderr:2020-11-20T11:50:26.118+0000 7fe4add6d700 -1 osd.0 0 waiting for initial osdmap 2020-11-20T11:50:31.414 INFO:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:31.541 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.535+0000 7fb661c08700 1 Processor -- start 2020-11-20T11:50:31.541 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.535+0000 7fb661c08700 1 -- start start 2020-11-20T11:50:31.541 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.536+0000 7fb661c08700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb65c0803b0 0x7fb65c0be430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.541 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.536+0000 7fb661c08700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb65c154660 0x7fb65c154af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.542 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.536+0000 7fb661c08700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65c1555c0 con 0x7fb65c0be050 2020-11-20T11:50:31.542 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.536+0000 7fb661c08700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65c155320 con 0x7fb65c154660 2020-11-20T11:50:31.542 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.536+0000 7fb661c08700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65c151210 con 0x7fb65c0803b0 2020-11-20T11:50:31.542 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.536+0000 7fb65bfff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb65c154660 0x7fb65c154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.542 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65bfff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb65c154660 0x7fb65c154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45072/0 (socket says 172.21.15.164:45072) 2020-11-20T11:50:31.543 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65bfff700 1 -- 172.21.15.164:0/2030646843 learned_addr learned my addr 172.21.15.164:0/2030646843 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:31.543 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65affd700 1 --2- 172.21.15.164:0/2030646843 >> v2:172.21.15.188:3300/0 conn(0x7fb65c0803b0 0x7fb65c0be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.545 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65bfff700 1 -- 172.21.15.164:0/2030646843 >> v2:172.21.15.188:3300/0 conn(0x7fb65c0803b0 msgr2=0x7fb65c0be430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:31.546 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65bfff700 1 --2- 172.21.15.164:0/2030646843 >> v2:172.21.15.188:3300/0 conn(0x7fb65c0803b0 0x7fb65c0be430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.546 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65bfff700 1 -- 172.21.15.164:0/2030646843 >> v1:172.21.15.188:6789/0 conn(0x7fb65c0be050 legacy=0x7fb65c0c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:31.546 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65bfff700 1 -- 172.21.15.164:0/2030646843 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c1514b0 con 0x7fb65c154660 2020-11-20T11:50:31.547 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65affd700 1 --2- 172.21.15.164:0/2030646843 >> v2:172.21.15.188:3300/0 conn(0x7fb65c0803b0 0x7fb65c0be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:31.547 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65bfff700 1 --2- 172.21.15.164:0/2030646843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c154660 0x7fb65c154af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb65c0bea70 tx=0x7fb654006ef0).ready entity=mon.1 client_cookie=5dd2b23af01d1ce4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:31.547 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65a7fc700 1 -- 172.21.15.164:0/2030646843 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65400b820 con 0x7fb65c154660 2020-11-20T11:50:31.547 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65a7fc700 1 -- 172.21.15.164:0/2030646843 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb654000e90 con 0x7fb65c154660 2020-11-20T11:50:31.548 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb65a7fc700 1 -- 172.21.15.164:0/2030646843 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65400bb90 con 0x7fb65c154660 2020-11-20T11:50:31.548 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb661c08700 1 -- 172.21.15.164:0/2030646843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c154660 msgr2=0x7fb65c154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:31.548 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.537+0000 7fb661c08700 1 --2- 172.21.15.164:0/2030646843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c154660 0x7fb65c154af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb65c0bea70 tx=0x7fb654006ef0).stop 2020-11-20T11:50:31.549 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.538+0000 7fb661c08700 1 -- 172.21.15.164:0/2030646843 shutdown_connections 2020-11-20T11:50:31.549 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.538+0000 7fb661c08700 1 --2- 172.21.15.164:0/2030646843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c154660 0x7fb65c154af0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.549 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.538+0000 7fb661c08700 1 --2- 172.21.15.164:0/2030646843 >> v2:172.21.15.188:3300/0 conn(0x7fb65c0803b0 0x7fb65c0be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.550 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.538+0000 7fb661c08700 1 -- 172.21.15.164:0/2030646843 >> 172.21.15.164:0/2030646843 conn(0x7fb65c082300 msgr2=0x7fb65c082710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:31.550 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.538+0000 7fb661c08700 1 -- 172.21.15.164:0/2030646843 shutdown_connections 2020-11-20T11:50:31.550 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.538+0000 7fb661c08700 1 -- 172.21.15.164:0/2030646843 wait complete. 2020-11-20T11:50:31.555 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.539+0000 7fb661c08700 1 Processor -- start 2020-11-20T11:50:31.556 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.539+0000 7fb661c08700 1 -- start start 2020-11-20T11:50:31.556 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb661c08700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb65c0803b0 0x7fb65c0c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.556 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb661c08700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c0be050 0x7fb65c0624f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.556 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb661c08700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb65c154660 0x7fb65c149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.557 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb661c08700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c0bec50 con 0x7fb65c154660 2020-11-20T11:50:31.557 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb661c08700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c0beef0 con 0x7fb65c0be050 2020-11-20T11:50:31.557 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb661c08700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c0bf190 con 0x7fb65c0803b0 2020-11-20T11:50:31.557 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65affd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c0be050 0x7fb65c0624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.557 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65affd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c0be050 0x7fb65c0624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45078/0 (socket says 172.21.15.164:45078) 2020-11-20T11:50:31.558 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65affd700 1 -- 172.21.15.164:0/648547870 learned_addr learned my addr 172.21.15.164:0/648547870 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:31.558 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65b7fe700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb65c0803b0 0x7fb65c0c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.558 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65bfff700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb65c154660 0x7fb65c149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.558 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65affd700 1 -- 172.21.15.164:0/648547870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb65c0803b0 msgr2=0x7fb65c0c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:31.558 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65affd700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb65c0803b0 0x7fb65c0c0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.559 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65affd700 1 -- 172.21.15.164:0/648547870 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb65c154660 msgr2=0x7fb65c149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:31.559 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65affd700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb65c154660 0x7fb65c149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.559 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65affd700 1 -- 172.21.15.164:0/648547870 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c0bf430 con 0x7fb65c0be050 2020-11-20T11:50:31.559 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb65affd700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c0be050 0x7fb65c0624f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb64400cb50 tx=0x7fb644008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:31.559 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb6537fe700 1 -- 172.21.15.164:0/648547870 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644007740 con 0x7fb65c0be050 2020-11-20T11:50:31.560 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb6537fe700 1 -- 172.21.15.164:0/648547870 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6440078a0 con 0x7fb65c0be050 2020-11-20T11:50:31.560 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb661c08700 1 -- 172.21.15.164:0/648547870 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65c0bf6d0 con 0x7fb65c0be050 2020-11-20T11:50:31.560 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb6537fe700 1 -- 172.21.15.164:0/648547870 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644007c20 con 0x7fb65c0be050 2020-11-20T11:50:31.560 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.540+0000 7fb661c08700 1 -- 172.21.15.164:0/648547870 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65c0c1140 con 0x7fb65c0be050 2020-11-20T11:50:31.560 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.541+0000 7fb661c08700 1 -- 172.21.15.164:0/648547870 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65c069b70 con 0x7fb65c0be050 2020-11-20T11:50:31.563 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.542+0000 7fb6537fe700 1 -- 172.21.15.164:0/648547870 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb644011410 con 0x7fb65c0be050 2020-11-20T11:50:31.563 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.542+0000 7fb6537fe700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb6380806a0 0x7fb638082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.563 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.543+0000 7fb6537fe700 1 -- 172.21.15.164:0/648547870 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6740+0+0 (secure 0 0 0) 0x7fb6440a2340 con 0x7fb65c0be050 2020-11-20T11:50:31.563 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.543+0000 7fb65b7fe700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb6380806a0 0x7fb638082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.564 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.543+0000 7fb65b7fe700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb6380806a0 0x7fb638082b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb64c003c70 tx=0x7fb64c009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:31.564 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.546+0000 7fb6537fe700 1 -- 172.21.15.164:0/648547870 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb644077370 con 0x7fb65c0be050 2020-11-20T11:50:31.695 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.692+0000 7fb661c08700 1 -- 172.21.15.164:0/648547870 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb65c151d20 con 0x7fb65c0be050 2020-11-20T11:50:31.696 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.693+0000 7fb6537fe700 1 -- 172.21.15.164:0/648547870 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16857 (secure 0 0 0) 0x7fb64407a990 con 0x7fb65c0be050 2020-11-20T11:50:31.696 INFO:teuthology.misc.health.smithi164.stdout: 2020-11-20T11:50:31.697 INFO:teuthology.misc.health.smithi164.stdout:{"epoch":19,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:29.120520+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:31.699 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.694+0000 7fb661c08700 1 -- 172.21.15.164:0/648547870 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb6380806a0 msgr2=0x7fb638082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:31.700 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.694+0000 7fb661c08700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb6380806a0 0x7fb638082b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb64c003c70 tx=0x7fb64c009040).stop 2020-11-20T11:50:31.701 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.694+0000 7fb661c08700 1 -- 172.21.15.164:0/648547870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c0be050 msgr2=0x7fb65c0624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:31.701 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.694+0000 7fb661c08700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c0be050 0x7fb65c0624f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb64400cb50 tx=0x7fb644008040).stop 2020-11-20T11:50:31.702 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.694+0000 7fb661c08700 1 -- 172.21.15.164:0/648547870 shutdown_connections 2020-11-20T11:50:31.702 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.694+0000 7fb661c08700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb6380806a0 0x7fb638082b60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.703 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.694+0000 7fb661c08700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb65c154660 0x7fb65c149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.703 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.694+0000 7fb661c08700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb65c0803b0 0x7fb65c0c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.703 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.694+0000 7fb661c08700 1 --2- 172.21.15.164:0/648547870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb65c0be050 0x7fb65c0624f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.704 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.694+0000 7fb661c08700 1 -- 172.21.15.164:0/648547870 >> 172.21.15.164:0/648547870 conn(0x7fb65c082300 msgr2=0x7fb65c09cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:31.705 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.695+0000 7fb661c08700 1 -- 172.21.15.164:0/648547870 shutdown_connections 2020-11-20T11:50:31.705 INFO:teuthology.misc.health.smithi164.stderr:2020-11-20T11:50:31.695+0000 7fb661c08700 1 -- 172.21.15.164:0/648547870 wait complete. 2020-11-20T11:50:31.711 DEBUG:teuthology.misc:12 of 12 OSDs are up 2020-11-20T11:50:31.713 INFO:tasks.ceph:Creating RBD pool 2020-11-20T11:50:31.714 INFO:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd pool create rbd 8 2020-11-20T11:50:31.827 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.824+0000 7faf64b29700 1 Processor -- start 2020-11-20T11:50:31.827 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.824+0000 7faf64b29700 1 -- start start 2020-11-20T11:50:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf64b29700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faf600c4200 0x7faf600bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf64b29700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faf600c0ba0 0x7faf600bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf64b29700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf60151780 con 0x7faf600c45e0 2020-11-20T11:50:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf64b29700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf600c4a60 con 0x7faf600c4200 2020-11-20T11:50:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf64b29700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf60151a20 con 0x7faf600c0ba0 2020-11-20T11:50:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf5ed9d700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faf600c0ba0 0x7faf600bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf5e59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faf600c4200 0x7faf600bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf5ed9d700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faf600c0ba0 0x7faf600bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.164:38348/0 (socket says 172.21.15.164:38348) 2020-11-20T11:50:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf5dd9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7faf600c45e0 0x7faf60150fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.164:40954/0 (socket says 172.21.15.164:40954) 2020-11-20T11:50:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf5ed9d700 1 -- 172.21.15.164:0/1572779893 learned_addr learned my addr 172.21.15.164:0/1572779893 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.825+0000 7faf5e59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faf600c4200 0x7faf600bccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.164:43514/0 (socket says 172.21.15.164:43514) 2020-11-20T11:50:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf5e59c700 1 -- 172.21.15.164:0/1572779893 >> v2:172.21.15.188:3300/0 conn(0x7faf600c0ba0 msgr2=0x7faf600bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf5e59c700 1 --2- 172.21.15.164:0/1572779893 >> v2:172.21.15.188:3300/0 conn(0x7faf600c0ba0 0x7faf600bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf5e59c700 1 -- 172.21.15.164:0/1572779893 >> v1:172.21.15.36:6789/0 conn(0x7faf600c45e0 legacy=0x7faf60150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf5e59c700 1 -- 172.21.15.164:0/1572779893 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60151cc0 con 0x7faf600c4200 2020-11-20T11:50:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf5d59a700 1 -- 172.21.15.164:0/1572779893 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489697963 0 0) 0x7faf60151780 con 0x7faf600c45e0 2020-11-20T11:50:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf5ed9d700 1 --2- 172.21.15.164:0/1572779893 >> v2:172.21.15.188:3300/0 conn(0x7faf600c0ba0 0x7faf600bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf5e59c700 1 --2- 172.21.15.164:0/1572779893 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf600c4200 0x7faf600bccf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7faf60061610 tx=0x7faf50006e30).ready entity=mon.0 client_cookie=f34f1e0cd1432278 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf5d59a700 1 -- 172.21.15.164:0/1572779893 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf500097b0 con 0x7faf600c4200 2020-11-20T11:50:31.833 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf5d59a700 1 -- 172.21.15.164:0/1572779893 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf50000e90 con 0x7faf600c4200 2020-11-20T11:50:31.833 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf5d59a700 1 -- 172.21.15.164:0/1572779893 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50009b20 con 0x7faf600c4200 2020-11-20T11:50:31.839 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf64b29700 1 -- 172.21.15.164:0/1572779893 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf600c4200 msgr2=0x7faf600bccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:31.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.826+0000 7faf64b29700 1 --2- 172.21.15.164:0/1572779893 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf600c4200 0x7faf600bccf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7faf60061610 tx=0x7faf50006e30).stop 2020-11-20T11:50:31.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.827+0000 7faf64b29700 1 -- 172.21.15.164:0/1572779893 shutdown_connections 2020-11-20T11:50:31.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.827+0000 7faf64b29700 1 --2- 172.21.15.164:0/1572779893 >> v2:172.21.15.188:3300/0 conn(0x7faf600c0ba0 0x7faf600bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.827+0000 7faf64b29700 1 --2- 172.21.15.164:0/1572779893 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf600c4200 0x7faf600bccf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.827+0000 7faf64b29700 1 -- 172.21.15.164:0/1572779893 >> 172.21.15.164:0/1572779893 conn(0x7faf600678e0 msgr2=0x7faf60067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.827+0000 7faf64b29700 1 -- 172.21.15.164:0/1572779893 shutdown_connections 2020-11-20T11:50:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.827+0000 7faf64b29700 1 -- 172.21.15.164:0/1572779893 wait complete. 2020-11-20T11:50:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.828+0000 7faf64b29700 1 Processor -- start 2020-11-20T11:50:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.828+0000 7faf64b29700 1 -- start start 2020-11-20T11:50:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.828+0000 7faf64b29700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf600c0ba0 0x7faf601570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.828+0000 7faf64b29700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf600c4200 0x7faf600c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.828+0000 7faf64b29700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf600c45e0 0x7faf600bd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.828+0000 7faf64b29700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf601605a0 con 0x7faf600c0ba0 2020-11-20T11:50:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.828+0000 7faf64b29700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60160840 con 0x7faf600c45e0 2020-11-20T11:50:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.828+0000 7faf64b29700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60160ae0 con 0x7faf600c4200 2020-11-20T11:50:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5ed9d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf600c45e0 0x7faf600bd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5ed9d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf600c45e0 0x7faf600bd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45092/0 (socket says 172.21.15.164:45092) 2020-11-20T11:50:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5ed9d700 1 -- 172.21.15.164:0/3179298734 learned_addr learned my addr 172.21.15.164:0/3179298734 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5e59c700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf600c0ba0 0x7faf601570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5dd9b700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf600c4200 0x7faf600c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5ed9d700 1 -- 172.21.15.164:0/3179298734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf600c4200 msgr2=0x7faf600c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5ed9d700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf600c4200 0x7faf600c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5ed9d700 1 -- 172.21.15.164:0/3179298734 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf600c0ba0 msgr2=0x7faf601570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5ed9d700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf600c0ba0 0x7faf601570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5ed9d700 1 -- 172.21.15.164:0/3179298734 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60160d80 con 0x7faf600c45e0 2020-11-20T11:50:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf5ed9d700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf600c45e0 0x7faf600bd3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7faf5800ef80 tx=0x7faf580092d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf4e7fc700 1 -- 172.21.15.164:0/3179298734 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800cdc0 con 0x7faf600c45e0 2020-11-20T11:50:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf4e7fc700 1 -- 172.21.15.164:0/3179298734 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf580123f0 con 0x7faf600c45e0 2020-11-20T11:50:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf64b29700 1 -- 172.21.15.164:0/3179298734 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf60161020 con 0x7faf600c45e0 2020-11-20T11:50:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf4e7fc700 1 -- 172.21.15.164:0/3179298734 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58012790 con 0x7faf600c45e0 2020-11-20T11:50:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.829+0000 7faf64b29700 1 -- 172.21.15.164:0/3179298734 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6014de20 con 0x7faf600c45e0 2020-11-20T11:50:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.830+0000 7faf64b29700 1 -- 172.21.15.164:0/3179298734 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf601613e0 con 0x7faf600c45e0 2020-11-20T11:50:31.847 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.831+0000 7faf4e7fc700 1 -- 172.21.15.164:0/3179298734 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7faf58022070 con 0x7faf600c45e0 2020-11-20T11:50:31.847 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.831+0000 7faf4e7fc700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf340806a0 0x7faf34082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:31.847 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.831+0000 7faf4e7fc700 1 -- 172.21.15.164:0/3179298734 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6740+0+0 (secure 0 0 0) 0x7faf580a2dc0 con 0x7faf600c45e0 2020-11-20T11:50:31.847 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.831+0000 7faf5e59c700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf340806a0 0x7faf34082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:31.847 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.831+0000 7faf5e59c700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf340806a0 0x7faf34082b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7faf50006e70 tx=0x7faf50015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:31.848 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.834+0000 7faf4e7fc700 1 -- 172.21.15.164:0/3179298734 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7faf58077e50 con 0x7faf600c45e0 2020-11-20T11:50:31.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:31.980+0000 7faf64b29700 1 -- 172.21.15.164:0/3179298734 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7faf601611b0 con 0x7faf600c45e0 2020-11-20T11:50:32.140 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.137+0000 7faf4e7fc700 1 -- 172.21.15.164:0/3179298734 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7faf58016070 con 0x7faf600c45e0 2020-11-20T11:50:32.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 -- 172.21.15.164:0/3179298734 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf340806a0 msgr2=0x7faf34082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:32.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf340806a0 0x7faf34082b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7faf50006e70 tx=0x7faf50015000).stop 2020-11-20T11:50:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 -- 172.21.15.164:0/3179298734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf600c45e0 msgr2=0x7faf600bd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf600c45e0 0x7faf600bd3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7faf5800ef80 tx=0x7faf580092d0).stop 2020-11-20T11:50:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 -- 172.21.15.164:0/3179298734 shutdown_connections 2020-11-20T11:50:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf340806a0 0x7faf34082b60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf600c45e0 0x7faf600bd3c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:32.144 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf600c0ba0 0x7faf601570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:32.144 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 --2- 172.21.15.164:0/3179298734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf600c4200 0x7faf600c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:32.144 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 -- 172.21.15.164:0/3179298734 >> 172.21.15.164:0/3179298734 conn(0x7faf600678e0 msgr2=0x7faf60154430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:32.144 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 -- 172.21.15.164:0/3179298734 shutdown_connections 2020-11-20T11:50:32.144 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.139+0000 7faf64b29700 1 -- 172.21.15.164:0/3179298734 wait complete. 2020-11-20T11:50:32.145 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'rbd' created 2020-11-20T11:50:32.154 INFO:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-11-20T11:50:32.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.268+0000 7f82f8612700 1 Processor -- start 2020-11-20T11:50:32.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.268+0000 7f82f8612700 1 -- start start 2020-11-20T11:50:32.273 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f8612700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f82f009d540 0x7f82f0150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:32.273 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f8612700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f82f0154590 0x7f82f009eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:32.274 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f8612700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f0154a20 con 0x7f82f009d160 2020-11-20T11:50:32.274 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f8612700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00631f0 con 0x7f82f0154590 2020-11-20T11:50:32.274 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f8612700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f0154c50 con 0x7f82f009d540 2020-11-20T11:50:32.274 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f5bad700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f82f009d540 0x7f82f0150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:32.274 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f5bad700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f82f009d540 0x7f82f0150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45100/0 (socket says 172.21.15.164:45100) 2020-11-20T11:50:32.275 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f5bad700 1 -- 172.21.15.164:0/2279319177 learned_addr learned my addr 172.21.15.164:0/2279319177 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:32.275 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f5bad700 1 -- 172.21.15.164:0/2279319177 >> v2:172.21.15.36:3300/0 conn(0x7f82f0154590 msgr2=0x7f82f009eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:32.275 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f5bad700 1 --2- 172.21.15.164:0/2279319177 >> v2:172.21.15.36:3300/0 conn(0x7f82f0154590 0x7f82f009eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:32.275 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.269+0000 7f82f5bad700 1 -- 172.21.15.164:0/2279319177 >> v1:172.21.15.188:6789/0 conn(0x7f82f009d160 legacy=0x7f82f0062ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f5bad700 1 -- 172.21.15.164:0/2279319177 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0154ef0 con 0x7f82f009d540 2020-11-20T11:50:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f5bad700 1 --2- 172.21.15.164:0/2279319177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f009d540 0x7f82f0150ff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f82f0061ac0 tx=0x7f82e0006e90).ready entity=mon.1 client_cookie=1d63a738fd60e146 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f53ac700 1 -- 172.21.15.164:0/2279319177 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0006030 con 0x7f82f009d540 2020-11-20T11:50:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f53ac700 1 -- 172.21.15.164:0/2279319177 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e0006190 con 0x7f82f009d540 2020-11-20T11:50:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f53ac700 1 -- 172.21.15.164:0/2279319177 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0006510 con 0x7f82f009d540 2020-11-20T11:50:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f8612700 1 -- 172.21.15.164:0/2279319177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f009d540 msgr2=0x7f82f0150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f8612700 1 --2- 172.21.15.164:0/2279319177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f009d540 0x7f82f0150ff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f82f0061ac0 tx=0x7f82e0006e90).stop 2020-11-20T11:50:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f8612700 1 -- 172.21.15.164:0/2279319177 shutdown_connections 2020-11-20T11:50:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f8612700 1 --2- 172.21.15.164:0/2279319177 >> v2:172.21.15.36:3300/0 conn(0x7f82f0154590 0x7f82f009eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:32.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f8612700 1 --2- 172.21.15.164:0/2279319177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f009d540 0x7f82f0150ff0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:32.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f8612700 1 -- 172.21.15.164:0/2279319177 >> 172.21.15.164:0/2279319177 conn(0x7f82f00678e0 msgr2=0x7f82f0067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:32.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f8612700 1 -- 172.21.15.164:0/2279319177 shutdown_connections 2020-11-20T11:50:32.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.270+0000 7f82f8612700 1 -- 172.21.15.164:0/2279319177 wait complete. 2020-11-20T11:50:32.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.271+0000 7f82f8612700 1 Processor -- start 2020-11-20T11:50:32.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.271+0000 7f82f8612700 1 -- start start 2020-11-20T11:50:32.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.272+0000 7f82f8612700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82f009d160 0x7f82f014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:32.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.272+0000 7f82f8612700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82f009d540 0x7f82f00c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:32.282 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.272+0000 7f82f8612700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f0154590 0x7f82f00c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:32.282 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.272+0000 7f82f8612700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0160640 con 0x7f82f009d540 2020-11-20T11:50:32.282 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.272+0000 7f82f8612700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f01608e0 con 0x7f82f0154590 2020-11-20T11:50:32.282 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.272+0000 7f82f8612700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0160b80 con 0x7f82f009d160 2020-11-20T11:50:32.282 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.272+0000 7f82f6baf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f0154590 0x7f82f00c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.272+0000 7f82f6baf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f0154590 0x7f82f00c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45106/0 (socket says 172.21.15.164:45106) 2020-11-20T11:50:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.272+0000 7f82f6baf700 1 -- 172.21.15.164:0/3888544057 learned_addr learned my addr 172.21.15.164:0/3888544057 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.272+0000 7f82f63ae700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82f009d160 0x7f82f014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82f6baf700 1 -- 172.21.15.164:0/3888544057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82f009d160 msgr2=0x7f82f014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82f6baf700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82f009d160 0x7f82f014fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82f5bad700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82f009d540 0x7f82f00c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82f6baf700 1 -- 172.21.15.164:0/3888544057 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82f009d540 msgr2=0x7f82f00c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82f6baf700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82f009d540 0x7f82f00c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82f6baf700 1 -- 172.21.15.164:0/3888544057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0160e20 con 0x7f82f0154590 2020-11-20T11:50:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82f6baf700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f0154590 0x7f82f00c72b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f82e800bae0 tx=0x7f82e80091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82de7fc700 1 -- 172.21.15.164:0/3888544057 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800c830 con 0x7f82f0154590 2020-11-20T11:50:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82de7fc700 1 -- 172.21.15.164:0/3888544057 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e800c990 con 0x7f82f0154590 2020-11-20T11:50:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82f8612700 1 -- 172.21.15.164:0/3888544057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f01610c0 con 0x7f82f0154590 2020-11-20T11:50:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82de7fc700 1 -- 172.21.15.164:0/3888544057 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800cb40 con 0x7f82f0154590 2020-11-20T11:50:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.273+0000 7f82f8612700 1 -- 172.21.15.164:0/3888544057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f01503c0 con 0x7f82f0154590 2020-11-20T11:50:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.274+0000 7f82f8612700 1 -- 172.21.15.164:0/3888544057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f0069b70 con 0x7f82f0154590 2020-11-20T11:50:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.274+0000 7f82de7fc700 1 -- 172.21.15.164:0/3888544057 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f82e801c070 con 0x7f82f0154590 2020-11-20T11:50:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.275+0000 7f82de7fc700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f82c8080670 0x7f82c8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.275+0000 7f82de7fc700 1 -- 172.21.15.164:0/3888544057 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f82e80a1d40 con 0x7f82f0154590 2020-11-20T11:50:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.275+0000 7f82f63ae700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f82c8080670 0x7f82c8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.275+0000 7f82f63ae700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f82c8080670 0x7f82c8082b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f82ec000c00 tx=0x7f82ec007b80).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.278+0000 7f82de7fc700 1 -- 172.21.15.164:0/3888544057 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f82e8076c80 con 0x7f82f0154590 2020-11-20T11:50:32.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:32.419+0000 7f82f8612700 1 -- 172.21.15.164:0/3888544057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f82f005d590 con 0x7f82f0154590 2020-11-20T11:50:33.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.140+0000 7f82de7fc700 1 -- 172.21.15.164:0/3888544057 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7f82e801a030 con 0x7f82f0154590 2020-11-20T11:50:33.145 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 -- 172.21.15.164:0/3888544057 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f82c8080670 msgr2=0x7f82c8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.146 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f82c8080670 0x7f82c8082b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f82ec000c00 tx=0x7f82ec007b80).stop 2020-11-20T11:50:33.146 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 -- 172.21.15.164:0/3888544057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f0154590 msgr2=0x7f82f00c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.146 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f0154590 0x7f82f00c72b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f82e800bae0 tx=0x7f82e80091d0).stop 2020-11-20T11:50:33.146 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 -- 172.21.15.164:0/3888544057 shutdown_connections 2020-11-20T11:50:33.147 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f82c8080670 0x7f82c8082b30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.147 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82f0154590 0x7f82f00c72b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.147 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82f009d160 0x7f82f014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.147 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 --2- 172.21.15.164:0/3888544057 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82f009d540 0x7f82f00c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.147 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 -- 172.21.15.164:0/3888544057 >> 172.21.15.164:0/3888544057 conn(0x7f82f00678e0 msgr2=0x7f82f0147ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:33.148 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 -- 172.21.15.164:0/3888544057 shutdown_connections 2020-11-20T11:50:33.148 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.143+0000 7f82f8612700 1 -- 172.21.15.164:0/3888544057 wait complete. 2020-11-20T11:50:33.148 INFO:teuthology.orchestra.run.smithi164.stderr:enabled application 'rbd' on pool 'rbd' 2020-11-20T11:50:33.158 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-11-20T11:50:33.159 INFO:tasks.ceph.mds.a:Restarting daemon 2020-11-20T11:50:33.159 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-11-20T11:50:33.161 INFO:tasks.ceph.mds.a:Started 2020-11-20T11:50:33.162 INFO:tasks.ceph.mds.b:Restarting daemon 2020-11-20T11:50:33.162 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-11-20T11:50:33.165 INFO:tasks.ceph.mds.b:Started 2020-11-20T11:50:33.166 INFO:tasks.ceph.mds.c:Restarting daemon 2020-11-20T11:50:33.166 INFO:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-11-20T11:50:33.168 INFO:tasks.ceph.mds.c:Started 2020-11-20T11:50:33.169 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-11-20T11:50:33.169 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:33.233 INFO:tasks.ceph.mds.a.smithi164.stdout:starting mds.a at 2020-11-20T11:50:33.242 INFO:tasks.ceph.mds.c.smithi188.stdout:starting mds.c at 2020-11-20T11:50:33.248 INFO:tasks.ceph.mds.b.smithi036.stdout:starting mds.b at 2020-11-20T11:50:33.289 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.284+0000 7f3df2469700 1 Processor -- start 2020-11-20T11:50:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.284+0000 7f3df2469700 1 -- start start 2020-11-20T11:50:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.285+0000 7f3df2469700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3dec0c4360 0x7f3dec0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.285+0000 7f3df2469700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3dec150520 0x7f3dec150950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.285+0000 7f3df2469700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec151220 con 0x7f3dec1550f0 2020-11-20T11:50:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.285+0000 7f3df2469700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0bd090 con 0x7f3dec150520 2020-11-20T11:50:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.285+0000 7f3df2469700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec1514c0 con 0x7f3dec0c4360 2020-11-20T11:50:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3df0a06700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3dec150520 0x7f3dec150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.292 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3debfff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3dec0c4360 0x7f3dec0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.292 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3df0a06700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3dec150520 0x7f3dec150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.164:43552/0 (socket says 172.21.15.164:43552) 2020-11-20T11:50:33.292 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3df0a06700 1 -- 172.21.15.164:0/3620941211 learned_addr learned my addr 172.21.15.164:0/3620941211 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:33.292 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3deb7fe700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f3dec1550f0 0x7f3dec0bfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.164:40176/0 (socket says 172.21.15.164:40176) 2020-11-20T11:50:33.292 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3debfff700 1 --2- 172.21.15.164:0/3620941211 >> v2:172.21.15.188:3300/0 conn(0x7f3dec0c4360 0x7f3dec0c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.164:38388/0 (socket says 172.21.15.164:38388) 2020-11-20T11:50:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3debfff700 1 -- 172.21.15.164:0/3620941211 >> v2:172.21.15.36:3300/0 conn(0x7f3dec150520 msgr2=0x7f3dec150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3debfff700 1 --2- 172.21.15.164:0/3620941211 >> v2:172.21.15.36:3300/0 conn(0x7f3dec150520 0x7f3dec150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3debfff700 1 -- 172.21.15.164:0/3620941211 >> v1:172.21.15.188:6789/0 conn(0x7f3dec1550f0 legacy=0x7f3dec0bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3deaffd700 1 -- 172.21.15.164:0/3620941211 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7783943 0 0) 0x7f3dec151220 con 0x7f3dec1550f0 2020-11-20T11:50:33.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3debfff700 1 -- 172.21.15.164:0/3620941211 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec151760 con 0x7f3dec0c4360 2020-11-20T11:50:33.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3df0a06700 1 --2- 172.21.15.164:0/3620941211 >> v2:172.21.15.36:3300/0 conn(0x7f3dec150520 0x7f3dec150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:33.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3debfff700 1 --2- 172.21.15.164:0/3620941211 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3dec0c4360 0x7f3dec0c4740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3dec063350 tx=0x7f3ddc006e30).ready entity=mon.2 client_cookie=1d4e008962d2e3f5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:33.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3deaffd700 1 -- 172.21.15.164:0/3620941211 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0097b0 con 0x7f3dec0c4360 2020-11-20T11:50:33.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3deaffd700 1 -- 172.21.15.164:0/3620941211 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc000e90 con 0x7f3dec0c4360 2020-11-20T11:50:33.295 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.286+0000 7f3deaffd700 1 -- 172.21.15.164:0/3620941211 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc009b20 con 0x7f3dec0c4360 2020-11-20T11:50:33.295 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.287+0000 7f3df2469700 1 -- 172.21.15.164:0/3620941211 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3dec0c4360 msgr2=0x7f3dec0c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.295 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.287+0000 7f3df2469700 1 --2- 172.21.15.164:0/3620941211 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3dec0c4360 0x7f3dec0c4740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3dec063350 tx=0x7f3ddc006e30).stop 2020-11-20T11:50:33.295 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.287+0000 7f3df2469700 1 -- 172.21.15.164:0/3620941211 shutdown_connections 2020-11-20T11:50:33.295 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.287+0000 7f3df2469700 1 --2- 172.21.15.164:0/3620941211 >> v2:172.21.15.36:3300/0 conn(0x7f3dec150520 0x7f3dec150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.296 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.287+0000 7f3df2469700 1 --2- 172.21.15.164:0/3620941211 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3dec0c4360 0x7f3dec0c4740 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.296 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.287+0000 7f3df2469700 1 -- 172.21.15.164:0/3620941211 >> 172.21.15.164:0/3620941211 conn(0x7f3dec0619e0 msgr2=0x7f3dec061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:33.296 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.287+0000 7f3df2469700 1 -- 172.21.15.164:0/3620941211 shutdown_connections 2020-11-20T11:50:33.296 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.287+0000 7f3df2469700 1 -- 172.21.15.164:0/3620941211 wait complete. 2020-11-20T11:50:33.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.288+0000 7f3df2469700 1 Processor -- start 2020-11-20T11:50:33.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.288+0000 7f3df2469700 1 -- start start 2020-11-20T11:50:33.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df2469700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3dec0c4360 0x7f3dec154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df2469700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3dec150520 0x7f3dec157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df2469700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dec1550f0 0x7f3dec1122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df2469700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec1607c0 con 0x7f3dec150520 2020-11-20T11:50:33.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df2469700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec160a60 con 0x7f3dec1550f0 2020-11-20T11:50:33.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df2469700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec160d00 con 0x7f3dec0c4360 2020-11-20T11:50:33.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df0a06700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dec1550f0 0x7f3dec1122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df0a06700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dec1550f0 0x7f3dec1122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45130/0 (socket says 172.21.15.164:45130) 2020-11-20T11:50:33.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df0a06700 1 -- 172.21.15.164:0/209790982 learned_addr learned my addr 172.21.15.164:0/209790982 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:33.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3debfff700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3dec0c4360 0x7f3dec154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3deb7fe700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3dec150520 0x7f3dec157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df0a06700 1 -- 172.21.15.164:0/209790982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3dec0c4360 msgr2=0x7f3dec154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df0a06700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3dec0c4360 0x7f3dec154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df0a06700 1 -- 172.21.15.164:0/209790982 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3dec150520 msgr2=0x7f3dec157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df0a06700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3dec150520 0x7f3dec157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df0a06700 1 -- 172.21.15.164:0/209790982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec160fa0 con 0x7f3dec1550f0 2020-11-20T11:50:33.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3debfff700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3dec0c4360 0x7f3dec154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:33.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df0a06700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dec1550f0 0x7f3dec1122e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3de400ef80 tx=0x7f3de40092d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:33.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3dcbfff700 1 -- 172.21.15.164:0/209790982 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400cc00 con 0x7f3dec1550f0 2020-11-20T11:50:33.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3dcbfff700 1 -- 172.21.15.164:0/209790982 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400cd60 con 0x7f3dec1550f0 2020-11-20T11:50:33.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3df2469700 1 -- 172.21.15.164:0/209790982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec161240 con 0x7f3dec1550f0 2020-11-20T11:50:33.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.289+0000 7f3dcbfff700 1 -- 172.21.15.164:0/209790982 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4012620 con 0x7f3dec1550f0 2020-11-20T11:50:33.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.290+0000 7f3df2469700 1 -- 172.21.15.164:0/209790982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec0c57f0 con 0x7f3dec1550f0 2020-11-20T11:50:33.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.290+0000 7f3df2469700 1 -- 172.21.15.164:0/209790982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec1613d0 con 0x7f3dec1550f0 2020-11-20T11:50:33.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.291+0000 7f3dcbfff700 1 -- 172.21.15.164:0/209790982 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3de4022070 con 0x7f3dec1550f0 2020-11-20T11:50:33.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.291+0000 7f3dcbfff700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3dc40806a0 0x7f3dc4082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.291+0000 7f3dcbfff700 1 -- 172.21.15.164:0/209790982 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f3de40a2e40 con 0x7f3dec1550f0 2020-11-20T11:50:33.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.292+0000 7f3debfff700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3dc40806a0 0x7f3dc4082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.292+0000 7f3debfff700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3dc40806a0 0x7f3dc4082b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3ddc006e70 tx=0x7f3ddc015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:33.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.295+0000 7f3dcbfff700 1 -- 172.21.15.164:0/209790982 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3de4077c60 con 0x7f3dec1550f0 2020-11-20T11:50:33.439 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.436+0000 7f3df2469700 1 -- 172.21.15.164:0/209790982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dec069b70 con 0x7f3dec1550f0 2020-11-20T11:50:33.440 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.437+0000 7f3dcbfff700 1 -- 172.21.15.164:0/209790982 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18391 (secure 0 0 0) 0x7f3de4016070 con 0x7f3dec1550f0 2020-11-20T11:50:33.440 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:33.441 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":21,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:33.135797+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 -- 172.21.15.164:0/209790982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3dc40806a0 msgr2=0x7f3dc4082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3dc40806a0 0x7f3dc4082b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3ddc006e70 tx=0x7f3ddc015000).stop 2020-11-20T11:50:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 -- 172.21.15.164:0/209790982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dec1550f0 msgr2=0x7f3dec1122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dec1550f0 0x7f3dec1122e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3de400ef80 tx=0x7f3de40092d0).stop 2020-11-20T11:50:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 -- 172.21.15.164:0/209790982 shutdown_connections 2020-11-20T11:50:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3dc40806a0 0x7f3dc4082b60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dec1550f0 0x7f3dec1122e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3dec0c4360 0x7f3dec154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 --2- 172.21.15.164:0/209790982 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3dec150520 0x7f3dec157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.444 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 -- 172.21.15.164:0/209790982 >> 172.21.15.164:0/209790982 conn(0x7f3dec0619e0 msgr2=0x7f3dec0bfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:33.444 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 -- 172.21.15.164:0/209790982 shutdown_connections 2020-11-20T11:50:33.444 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.439+0000 7f3df2469700 1 -- 172.21.15.164:0/209790982 wait complete. 2020-11-20T11:50:33.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:50:22.130897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:50:32.016548+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-11-20T11:50:33.454 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:50:33.574 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.562+0000 7fe72dc9d700 1 Processor -- start 2020-11-20T11:50:33.575 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.562+0000 7fe72dc9d700 1 -- start start 2020-11-20T11:50:33.575 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.563+0000 7fe72dc9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe7280c4200 0x7fe7280bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.575 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.563+0000 7fe72dc9d700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe7280c0ba0 0x7fe7280bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.576 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.563+0000 7fe72dc9d700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe728151780 con 0x7fe7280c45e0 2020-11-20T11:50:33.576 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.563+0000 7fe72dc9d700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280c4a60 con 0x7fe7280c4200 2020-11-20T11:50:33.576 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.563+0000 7fe72dc9d700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe728151a20 con 0x7fe7280c0ba0 2020-11-20T11:50:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.563+0000 7fe7277fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe7280c4200 0x7fe7280bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.563+0000 7fe7277fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe7280c4200 0x7fe7280bccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45134/0 (socket says 172.21.15.164:45134) 2020-11-20T11:50:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.563+0000 7fe7277fe700 1 -- 172.21.15.164:0/2018390037 learned_addr learned my addr 172.21.15.164:0/2018390037 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.563+0000 7fe727fff700 1 --2- 172.21.15.164:0/2018390037 >> v2:172.21.15.188:3300/0 conn(0x7fe7280c0ba0 0x7fe7280bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe7277fe700 1 -- 172.21.15.164:0/2018390037 >> v2:172.21.15.188:3300/0 conn(0x7fe7280c0ba0 msgr2=0x7fe7280bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:33.578 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe7277fe700 1 --2- 172.21.15.164:0/2018390037 >> v2:172.21.15.188:3300/0 conn(0x7fe7280c0ba0 0x7fe7280bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.578 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe7277fe700 1 -- 172.21.15.164:0/2018390037 >> v1:172.21.15.188:6789/0 conn(0x7fe7280c45e0 legacy=0x7fe728150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.578 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe7277fe700 1 -- 172.21.15.164:0/2018390037 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728151cc0 con 0x7fe7280c4200 2020-11-20T11:50:33.578 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe7277fe700 1 --2- 172.21.15.164:0/2018390037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 0x7fe7280bccf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe728061610 tx=0x7fe718006ef0).ready entity=mon.1 client_cookie=bf34499706c89d9d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:33.579 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe7267fc700 1 -- 172.21.15.164:0/2018390037 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71800b860 con 0x7fe7280c4200 2020-11-20T11:50:33.579 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe7267fc700 1 -- 172.21.15.164:0/2018390037 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718000e90 con 0x7fe7280c4200 2020-11-20T11:50:33.579 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe7267fc700 1 -- 172.21.15.164:0/2018390037 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71800bbd0 con 0x7fe7280c4200 2020-11-20T11:50:33.579 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe72dc9d700 1 -- 172.21.15.164:0/2018390037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 msgr2=0x7fe7280bccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.580 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe72dc9d700 1 --2- 172.21.15.164:0/2018390037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 0x7fe7280bccf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe728061610 tx=0x7fe718006ef0).stop 2020-11-20T11:50:33.580 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe72dc9d700 1 -- 172.21.15.164:0/2018390037 shutdown_connections 2020-11-20T11:50:33.581 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe72dc9d700 1 --2- 172.21.15.164:0/2018390037 >> v2:172.21.15.188:3300/0 conn(0x7fe7280c0ba0 0x7fe7280bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.581 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe72dc9d700 1 --2- 172.21.15.164:0/2018390037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 0x7fe7280bccf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.581 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe72dc9d700 1 -- 172.21.15.164:0/2018390037 >> 172.21.15.164:0/2018390037 conn(0x7fe7280678e0 msgr2=0x7fe728067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:33.581 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe72dc9d700 1 -- 172.21.15.164:0/2018390037 shutdown_connections 2020-11-20T11:50:33.582 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.564+0000 7fe72dc9d700 1 -- 172.21.15.164:0/2018390037 wait complete. 2020-11-20T11:50:33.582 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe72dc9d700 1 Processor -- start 2020-11-20T11:50:33.582 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe72dc9d700 1 -- start start 2020-11-20T11:50:33.582 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe72dc9d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7280c0ba0 0x7fe728150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.583 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe72dc9d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 0x7fe7280c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.583 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe72dc9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7280c45e0 0x7fe728163890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.583 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe72dc9d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72814fb60 con 0x7fe7280c45e0 2020-11-20T11:50:33.583 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe72dc9d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72814f620 con 0x7fe7280c4200 2020-11-20T11:50:33.583 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe72dc9d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72814f8c0 con 0x7fe7280c0ba0 2020-11-20T11:50:33.584 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe726ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 0x7fe7280c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.584 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe726ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 0x7fe7280c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45142/0 (socket says 172.21.15.164:45142) 2020-11-20T11:50:33.584 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe726ffd700 1 -- 172.21.15.164:0/4055630682 learned_addr learned my addr 172.21.15.164:0/4055630682 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:33.585 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.566+0000 7fe7277fe700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7280c0ba0 0x7fe728150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.585 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe726ffd700 1 -- 172.21.15.164:0/4055630682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7280c0ba0 msgr2=0x7fe728150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.585 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe726ffd700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7280c0ba0 0x7fe728150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.585 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe726ffd700 1 -- 172.21.15.164:0/4055630682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7280c45e0 msgr2=0x7fe728163890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.586 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe726ffd700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7280c45e0 0x7fe728163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:33.586 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe726ffd700 1 -- 172.21.15.164:0/4055630682 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280c56d0 con 0x7fe7280c4200 2020-11-20T11:50:33.586 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe726ffd700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 0x7fe7280c60b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe71c00c710 tx=0x7fe71c007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:33.586 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe7077fe700 1 -- 172.21.15.164:0/4055630682 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00e4a0 con 0x7fe7280c4200 2020-11-20T11:50:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe7077fe700 1 -- 172.21.15.164:0/4055630682 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c00e600 con 0x7fe7280c4200 2020-11-20T11:50:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe7077fe700 1 -- 172.21.15.164:0/4055630682 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00e9a0 con 0x7fe7280c4200 2020-11-20T11:50:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe72dc9d700 1 -- 172.21.15.164:0/4055630682 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7280c5970 con 0x7fe7280c4200 2020-11-20T11:50:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.567+0000 7fe72dc9d700 1 -- 172.21.15.164:0/4055630682 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe728150be0 con 0x7fe7280c4200 2020-11-20T11:50:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.568+0000 7fe72dc9d700 1 -- 172.21.15.164:0/4055630682 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7280c5dd0 con 0x7fe7280c4200 2020-11-20T11:50:33.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.568+0000 7fe7077fe700 1 -- 172.21.15.164:0/4055630682 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe71c010030 con 0x7fe7280c4200 2020-11-20T11:50:33.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.569+0000 7fe7077fe700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe700080670 0x7fe700082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.569+0000 7fe7077fe700 1 -- 172.21.15.164:0/4055630682 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fe71c0a22b0 con 0x7fe7280c4200 2020-11-20T11:50:33.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.569+0000 7fe7277fe700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe700080670 0x7fe700082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.569+0000 7fe7277fe700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe700080670 0x7fe700082b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe718006f30 tx=0x7fe718016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.572+0000 7fe7077fe700 1 -- 172.21.15.164:0/4055630682 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe71c0771e0 con 0x7fe7280c4200 2020-11-20T11:50:33.718 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.715+0000 7fe72dc9d700 1 -- 172.21.15.164:0/4055630682 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe728069b70 con 0x7fe7280c4200 2020-11-20T11:50:33.718 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.715+0000 7fe7077fe700 1 -- 172.21.15.164:0/4055630682 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe71c07a800 con 0x7fe7280c4200 2020-11-20T11:50:33.718 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2020-11-20T11:50:33.719 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 -- 172.21.15.164:0/4055630682 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe700080670 msgr2=0x7fe700082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.720 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe700080670 0x7fe700082b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe718006f30 tx=0x7fe718016000).stop 2020-11-20T11:50:33.720 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 -- 172.21.15.164:0/4055630682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 msgr2=0x7fe7280c60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.720 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 0x7fe7280c60b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe71c00c710 tx=0x7fe71c007c40).stop 2020-11-20T11:50:33.720 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 -- 172.21.15.164:0/4055630682 shutdown_connections 2020-11-20T11:50:33.721 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe700080670 0x7fe700082b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.725 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7280c45e0 0x7fe728163890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:33.725 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7280c0ba0 0x7fe728150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.725 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 --2- 172.21.15.164:0/4055630682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7280c4200 0x7fe7280c60b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.726 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 -- 172.21.15.164:0/4055630682 >> 172.21.15.164:0/4055630682 conn(0x7fe7280678e0 msgr2=0x7fe728150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:33.726 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 -- 172.21.15.164:0/4055630682 shutdown_connections 2020-11-20T11:50:33.726 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.716+0000 7fe72dc9d700 1 -- 172.21.15.164:0/4055630682 wait complete. 2020-11-20T11:50:33.732 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:50:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.870+0000 7fc81eac3700 1 Processor -- start 2020-11-20T11:50:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.870+0000 7fc81eac3700 1 -- start start 2020-11-20T11:50:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.871+0000 7fc81eac3700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc8180c1180 0x7fc8180bc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.871+0000 7fc81eac3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81814dbc0 con 0x7fc8180c0da0 2020-11-20T11:50:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.871+0000 7fc81eac3700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81814de60 con 0x7fc8180bc680 2020-11-20T11:50:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.871+0000 7fc81eac3700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8180664c0 con 0x7fc8180c1180 2020-11-20T11:50:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.871+0000 7fc81d2c0700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc8180c1180 0x7fc8180bc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.871+0000 7fc81e2c2700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc8180bc680 0x7fc8180bd000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:54890/0 (socket says 172.21.15.164:54890) 2020-11-20T11:50:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.871+0000 7fc81e2c2700 1 -- 172.21.15.164:0/1046054718 learned_addr learned my addr 172.21.15.164:0/1046054718 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.872+0000 7fc81d2c0700 1 -- 172.21.15.164:0/1046054718 >> v1:172.21.15.164:6789/0 conn(0x7fc8180bc680 legacy=0x7fc8180bd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.872+0000 7fc81d2c0700 1 -- 172.21.15.164:0/1046054718 >> v1:172.21.15.36:6789/0 conn(0x7fc8180c0da0 legacy=0x7fc818065db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.872+0000 7fc81cabf700 1 -- 172.21.15.164:0/1046054718 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048003194 0 0) 0x7fc81814de60 con 0x7fc8180bc680 2020-11-20T11:50:33.880 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.872+0000 7fc81d2c0700 1 -- 172.21.15.164:0/1046054718 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81814e100 con 0x7fc8180c1180 2020-11-20T11:50:33.880 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.872+0000 7fc81d2c0700 1 --2- 172.21.15.164:0/1046054718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180c1180 0x7fc8180bc190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc80800ba00 tx=0x7fc808006e30).ready entity=mon.1 client_cookie=8816f77b974a1356 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:33.880 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.872+0000 7fc81cabf700 1 -- 172.21.15.164:0/1046054718 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808009830 con 0x7fc8180c1180 2020-11-20T11:50:33.881 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.872+0000 7fc81cabf700 1 -- 172.21.15.164:0/1046054718 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc808000e90 con 0x7fc8180c1180 2020-11-20T11:50:33.881 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.872+0000 7fc81cabf700 1 -- 172.21.15.164:0/1046054718 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808009ba0 con 0x7fc8180c1180 2020-11-20T11:50:33.881 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.872+0000 7fc81eac3700 1 -- 172.21.15.164:0/1046054718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180c1180 msgr2=0x7fc8180bc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.882 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.872+0000 7fc81eac3700 1 --2- 172.21.15.164:0/1046054718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180c1180 0x7fc8180bc190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc80800ba00 tx=0x7fc808006e30).stop 2020-11-20T11:50:33.882 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.873+0000 7fc81eac3700 1 -- 172.21.15.164:0/1046054718 shutdown_connections 2020-11-20T11:50:33.882 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.873+0000 7fc81eac3700 1 --2- 172.21.15.164:0/1046054718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180c1180 0x7fc8180bc190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.882 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.873+0000 7fc81eac3700 1 -- 172.21.15.164:0/1046054718 >> 172.21.15.164:0/1046054718 conn(0x7fc81805bac0 msgr2=0x7fc81805bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:33.883 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.873+0000 7fc81eac3700 1 -- 172.21.15.164:0/1046054718 shutdown_connections 2020-11-20T11:50:33.883 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.873+0000 7fc81eac3700 1 -- 172.21.15.164:0/1046054718 wait complete. 2020-11-20T11:50:33.883 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.874+0000 7fc81eac3700 1 Processor -- start 2020-11-20T11:50:33.884 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.874+0000 7fc81eac3700 1 -- start start 2020-11-20T11:50:33.887 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.874+0000 7fc81eac3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180bc680 0x7fc818061d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.874+0000 7fc81eac3700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8180c0da0 0x7fc818151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.874+0000 7fc81eac3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc8180c1180 0x7fc8181502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.874+0000 7fc81eac3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818150b90 con 0x7fc8180c1180 2020-11-20T11:50:33.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.874+0000 7fc81eac3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818060e50 con 0x7fc8180bc680 2020-11-20T11:50:33.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.874+0000 7fc81eac3700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8180610f0 con 0x7fc8180c0da0 2020-11-20T11:50:33.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81dac1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180bc680 0x7fc818061d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81dac1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180bc680 0x7fc818061d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45154/0 (socket says 172.21.15.164:45154) 2020-11-20T11:50:33.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81dac1700 1 -- 172.21.15.164:0/3686829961 learned_addr learned my addr 172.21.15.164:0/3686829961 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:33.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81e2c2700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc8180c1180 0x7fc8181502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81d2c0700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8180c0da0 0x7fc818151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81dac1700 1 -- 172.21.15.164:0/3686829961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8180c0da0 msgr2=0x7fc818151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81dac1700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8180c0da0 0x7fc818151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81dac1700 1 -- 172.21.15.164:0/3686829961 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc8180c1180 msgr2=0x7fc8181502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81dac1700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc8180c1180 0x7fc8181502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81dac1700 1 -- 172.21.15.164:0/3686829961 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818061390 con 0x7fc8180bc680 2020-11-20T11:50:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81d2c0700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8180c0da0 0x7fc818151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81e2c2700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc8180c1180 0x7fc8181502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81dac1700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180bc680 0x7fc818061d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc81400c740 tx=0x7fc814007c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc805ffb700 1 -- 172.21.15.164:0/3686829961 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814007020 con 0x7fc8180bc680 2020-11-20T11:50:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc805ffb700 1 -- 172.21.15.164:0/3686829961 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc814001e90 con 0x7fc8180bc680 2020-11-20T11:50:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81eac3700 1 -- 172.21.15.164:0/3686829961 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc818061630 con 0x7fc8180bc680 2020-11-20T11:50:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc805ffb700 1 -- 172.21.15.164:0/3686829961 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8140073b0 con 0x7fc8180bc680 2020-11-20T11:50:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.875+0000 7fc81eac3700 1 -- 172.21.15.164:0/3686829961 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81814c7e0 con 0x7fc8180bc680 2020-11-20T11:50:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.876+0000 7fc81eac3700 1 -- 172.21.15.164:0/3686829961 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc818061a90 con 0x7fc8180bc680 2020-11-20T11:50:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.877+0000 7fc805ffb700 1 -- 172.21.15.164:0/3686829961 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc814010070 con 0x7fc8180bc680 2020-11-20T11:50:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.877+0000 7fc805ffb700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc7f00806a0 0x7fc7f0082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.877+0000 7fc805ffb700 1 -- 172.21.15.164:0/3686829961 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fc8140a1830 con 0x7fc8180bc680 2020-11-20T11:50:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.877+0000 7fc81d2c0700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc7f00806a0 0x7fc7f0082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.878+0000 7fc81d2c0700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc7f00806a0 0x7fc7f0082b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc8180bc5a0 tx=0x7fc808017000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:33.881+0000 7fc805ffb700 1 -- 172.21.15.164:0/3686829961 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc814076760 con 0x7fc8180bc680 2020-11-20T11:50:34.023 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.021+0000 7fc81eac3700 1 -- 172.21.15.164:0/3686829961 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc818044fa0 con 0x7fc8180bc680 2020-11-20T11:50:34.024 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.021+0000 7fc805ffb700 1 -- 172.21.15.164:0/3686829961 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc814079d80 con 0x7fc8180bc680 2020-11-20T11:50:34.024 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 8 2020-11-20T11:50:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 -- 172.21.15.164:0/3686829961 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc7f00806a0 msgr2=0x7fc7f0082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc7f00806a0 0x7fc7f0082b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc8180bc5a0 tx=0x7fc808017000).stop 2020-11-20T11:50:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 -- 172.21.15.164:0/3686829961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180bc680 msgr2=0x7fc818061d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180bc680 0x7fc818061d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc81400c740 tx=0x7fc814007c90).stop 2020-11-20T11:50:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 -- 172.21.15.164:0/3686829961 shutdown_connections 2020-11-20T11:50:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc7f00806a0 0x7fc7f0082b60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8180bc680 0x7fc818061d70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc8180c1180 0x7fc8181502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 --2- 172.21.15.164:0/3686829961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc8180c0da0 0x7fc818151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 -- 172.21.15.164:0/3686829961 >> 172.21.15.164:0/3686829961 conn(0x7fc81805bac0 msgr2=0x7fc8180c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 -- 172.21.15.164:0/3686829961 shutdown_connections 2020-11-20T11:50:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.022+0000 7fc81eac3700 1 -- 172.21.15.164:0/3686829961 wait complete. 2020-11-20T11:50:34.037 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2020-11-20T11:50:34.149 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.147+0000 7f476bb6b700 1 Processor -- start 2020-11-20T11:50:34.150 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.147+0000 7f476bb6b700 1 -- start start 2020-11-20T11:50:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f476bb6b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f47640c4740 0x7f47641550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f476bb6b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47641555e0 con 0x7f47640c4360 2020-11-20T11:50:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f476bb6b700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4764151220 con 0x7f4764150520 2020-11-20T11:50:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f476bb6b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47640bd090 con 0x7f47640c4740 2020-11-20T11:50:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f4769106700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f47640c4740 0x7f47641550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f4769106700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f47640c4740 0x7f47641550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.164:43596/0 (socket says 172.21.15.164:43596) 2020-11-20T11:50:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f4769106700 1 -- 172.21.15.164:0/2775808767 learned_addr learned my addr 172.21.15.164:0/2775808767 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f4769106700 1 -- 172.21.15.164:0/2775808767 >> v1:172.21.15.188:6789/0 conn(0x7f4764150520 legacy=0x7f4764150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f4769106700 1 -- 172.21.15.164:0/2775808767 >> v1:172.21.15.36:6789/0 conn(0x7f47640c4360 legacy=0x7f47640bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f4769106700 1 -- 172.21.15.164:0/2775808767 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47641514c0 con 0x7f47640c4740 2020-11-20T11:50:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.148+0000 7f4769106700 1 --2- 172.21.15.164:0/2775808767 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47640c4740 0x7f47641550f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4754009a10 tx=0x7f4754006ef0).ready entity=mon.0 client_cookie=5f26e56468a2e9c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.150+0000 7f4768905700 1 -- 172.21.15.164:0/2775808767 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400b860 con 0x7f47640c4740 2020-11-20T11:50:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.150+0000 7f4768905700 1 -- 172.21.15.164:0/2775808767 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4754000e90 con 0x7f47640c4740 2020-11-20T11:50:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.150+0000 7f4768905700 1 -- 172.21.15.164:0/2775808767 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400bbd0 con 0x7f47640c4740 2020-11-20T11:50:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.151+0000 7f476bb6b700 1 -- 172.21.15.164:0/2775808767 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47640c4740 msgr2=0x7f47641550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.151+0000 7f476bb6b700 1 --2- 172.21.15.164:0/2775808767 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47640c4740 0x7f47641550f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4754009a10 tx=0x7f4754006ef0).stop 2020-11-20T11:50:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.151+0000 7f476bb6b700 1 -- 172.21.15.164:0/2775808767 shutdown_connections 2020-11-20T11:50:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.151+0000 7f476bb6b700 1 --2- 172.21.15.164:0/2775808767 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47640c4740 0x7f47641550f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.151+0000 7f476bb6b700 1 -- 172.21.15.164:0/2775808767 >> 172.21.15.164:0/2775808767 conn(0x7f47640619e0 msgr2=0x7f4764061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.151+0000 7f476bb6b700 1 -- 172.21.15.164:0/2775808767 shutdown_connections 2020-11-20T11:50:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.151+0000 7f476bb6b700 1 -- 172.21.15.164:0/2775808767 wait complete. 2020-11-20T11:50:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.152+0000 7f476bb6b700 1 Processor -- start 2020-11-20T11:50:34.160 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.152+0000 7f476bb6b700 1 -- start start 2020-11-20T11:50:34.160 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476bb6b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47640c4360 0x7f4764160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:34.160 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476bb6b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47640c4740 0x7f4764157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:34.160 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476bb6b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4764150520 0x7f476414c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:34.160 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476bb6b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764160fa0 con 0x7f47640c4740 2020-11-20T11:50:34.161 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476bb6b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764161240 con 0x7f4764150520 2020-11-20T11:50:34.161 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476bb6b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47641614e0 con 0x7f47640c4360 2020-11-20T11:50:34.161 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476a108700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4764150520 0x7f476414c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:34.161 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476a108700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4764150520 0x7f476414c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45170/0 (socket says 172.21.15.164:45170) 2020-11-20T11:50:34.161 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476a108700 1 -- 172.21.15.164:0/1398329183 learned_addr learned my addr 172.21.15.164:0/1398329183 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:34.162 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f4769907700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47640c4360 0x7f4764160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:34.162 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f4769106700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47640c4740 0x7f4764157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:34.162 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476a108700 1 -- 172.21.15.164:0/1398329183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47640c4360 msgr2=0x7f4764160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.162 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476a108700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47640c4360 0x7f4764160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.162 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476a108700 1 -- 172.21.15.164:0/1398329183 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47640c4740 msgr2=0x7f4764157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.163 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476a108700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47640c4740 0x7f4764157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.163 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476a108700 1 -- 172.21.15.164:0/1398329183 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764161da0 con 0x7f4764150520 2020-11-20T11:50:34.163 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f4769106700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47640c4740 0x7f4764157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:34.163 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.153+0000 7f476a108700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4764150520 0x7f476414c5c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f475c00ca90 tx=0x7f475c0013a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:34.163 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.154+0000 7f4751ffb700 1 -- 172.21.15.164:0/1398329183 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00ce50 con 0x7f4764150520 2020-11-20T11:50:34.164 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.154+0000 7f4751ffb700 1 -- 172.21.15.164:0/1398329183 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00a760 con 0x7f4764150520 2020-11-20T11:50:34.164 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.154+0000 7f476bb6b700 1 -- 172.21.15.164:0/1398329183 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4764162040 con 0x7f4764150520 2020-11-20T11:50:34.164 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.154+0000 7f4751ffb700 1 -- 172.21.15.164:0/1398329183 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00aae0 con 0x7f4764150520 2020-11-20T11:50:34.164 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.154+0000 7f476bb6b700 1 -- 172.21.15.164:0/1398329183 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4764158120 con 0x7f4764150520 2020-11-20T11:50:34.164 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.155+0000 7f476bb6b700 1 -- 172.21.15.164:0/1398329183 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47641616a0 con 0x7f4764150520 2020-11-20T11:50:34.165 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.155+0000 7f4751ffb700 1 -- 172.21.15.164:0/1398329183 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f475c018020 con 0x7f4764150520 2020-11-20T11:50:34.165 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.156+0000 7f4751ffb700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f473c080670 0x7f473c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:34.165 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.156+0000 7f4751ffb700 1 -- 172.21.15.164:0/1398329183 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f475c0a2220 con 0x7f4764150520 2020-11-20T11:50:34.165 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.156+0000 7f4769907700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f473c080670 0x7f473c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:34.165 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.156+0000 7f4769907700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f473c080670 0x7f473c082b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4760007fd0 tx=0x7f4760007bd0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:34.166 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.159+0000 7f4751ffb700 1 -- 172.21.15.164:0/1398329183 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f475c077150 con 0x7f4764150520 2020-11-20T11:50:34.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.303+0000 7f476bb6b700 1 -- 172.21.15.164:0/1398329183 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f47641621d0 con 0x7f4764150520 2020-11-20T11:50:34.306 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.303+0000 7f4751ffb700 1 -- 172.21.15.164:0/1398329183 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) v1 ==== 84+0+143 (secure 0 0 0) 0x7f475c016090 con 0x7f4764150520 2020-11-20T11:50:34.306 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:34.306 INFO:teuthology.orchestra.run.smithi164.stdout:[ 2020-11-20T11:50:34.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2020-11-20T11:50:34.307 INFO:teuthology.orchestra.run.smithi164.stdout: "poolnum": 1, 2020-11-20T11:50:34.307 INFO:teuthology.orchestra.run.smithi164.stdout: "poolname": "device_health_metrics" 2020-11-20T11:50:34.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2020-11-20T11:50:34.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2020-11-20T11:50:34.308 INFO:teuthology.orchestra.run.smithi164.stdout: "poolnum": 2, 2020-11-20T11:50:34.308 INFO:teuthology.orchestra.run.smithi164.stdout: "poolname": "rbd" 2020-11-20T11:50:34.308 INFO:teuthology.orchestra.run.smithi164.stdout: } 2020-11-20T11:50:34.308 INFO:teuthology.orchestra.run.smithi164.stdout:] 2020-11-20T11:50:34.310 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 -- 172.21.15.164:0/1398329183 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f473c080670 msgr2=0x7f473c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.310 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f473c080670 0x7f473c082b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4760007fd0 tx=0x7f4760007bd0).stop 2020-11-20T11:50:34.310 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 -- 172.21.15.164:0/1398329183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4764150520 msgr2=0x7f476414c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.310 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4764150520 0x7f476414c5c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f475c00ca90 tx=0x7f475c0013a0).stop 2020-11-20T11:50:34.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 -- 172.21.15.164:0/1398329183 shutdown_connections 2020-11-20T11:50:34.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f473c080670 0x7f473c082b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4764150520 0x7f476414c5c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47640c4360 0x7f4764160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 --2- 172.21.15.164:0/1398329183 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47640c4740 0x7f4764157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.312 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 -- 172.21.15.164:0/1398329183 >> 172.21.15.164:0/1398329183 conn(0x7f47640619e0 msgr2=0x7f47640c1230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:34.312 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 -- 172.21.15.164:0/1398329183 shutdown_connections 2020-11-20T11:50:34.312 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.305+0000 7f476bb6b700 1 -- 172.21.15.164:0/1398329183 wait complete. 2020-11-20T11:50:34.318 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-11-20T11:50:34.319 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2020-11-20T11:50:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.429+0000 7f8a8e710700 1 Processor -- start 2020-11-20T11:50:34.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.429+0000 7f8a8e710700 1 -- start start 2020-11-20T11:50:34.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a8e710700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8a880bccf0 0x7f8a880c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:34.642 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a8e710700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a881555a0 con 0x7f8a880bf680 2020-11-20T11:50:34.642 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a8e710700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a881517d0 con 0x7f8a880c4470 2020-11-20T11:50:34.642 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a8e710700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a88151a70 con 0x7f8a880bccf0 2020-11-20T11:50:34.642 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a87fff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f8a880c4470 0x7f8a880c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:54916/0 (socket says 172.21.15.164:54916) 2020-11-20T11:50:34.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a87fff700 1 -- 172.21.15.164:0/3589618068 learned_addr learned my addr 172.21.15.164:0/3589618068 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:34.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a877fe700 1 --2- 172.21.15.164:0/3589618068 >> v2:172.21.15.164:3300/0 conn(0x7f8a880bccf0 0x7f8a880c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:34.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a86ffd700 1 -- 172.21.15.164:0/3589618068 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48983929 0 0) 0x7f8a881517d0 con 0x7f8a880c4470 2020-11-20T11:50:34.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a86ffd700 1 -- 172.21.15.164:0/3589618068 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a74003280 con 0x7f8a880c4470 2020-11-20T11:50:34.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a877fe700 1 -- 172.21.15.164:0/3589618068 >> v1:172.21.15.164:6789/0 conn(0x7f8a880c4470 legacy=0x7f8a880c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a877fe700 1 -- 172.21.15.164:0/3589618068 >> v1:172.21.15.36:6789/0 conn(0x7f8a880bf680 legacy=0x7f8a881504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.430+0000 7f8a877fe700 1 -- 172.21.15.164:0/3589618068 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a88151d10 con 0x7f8a880bccf0 2020-11-20T11:50:34.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a877fe700 1 --2- 172.21.15.164:0/3589618068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 0x7f8a880c4850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8a7c006fd0 tx=0x7f8a7c006e30).ready entity=mon.1 client_cookie=5752845577936162 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:34.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a86ffd700 1 -- 172.21.15.164:0/3589618068 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c009870 con 0x7f8a880bccf0 2020-11-20T11:50:34.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a86ffd700 1 -- 172.21.15.164:0/3589618068 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c000e90 con 0x7f8a880bccf0 2020-11-20T11:50:34.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a86ffd700 1 -- 172.21.15.164:0/3589618068 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c009be0 con 0x7f8a880bccf0 2020-11-20T11:50:34.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a8e710700 1 -- 172.21.15.164:0/3589618068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 msgr2=0x7f8a880c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a8e710700 1 --2- 172.21.15.164:0/3589618068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 0x7f8a880c4850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8a7c006fd0 tx=0x7f8a7c006e30).stop 2020-11-20T11:50:34.647 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a8e710700 1 -- 172.21.15.164:0/3589618068 shutdown_connections 2020-11-20T11:50:34.647 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a8e710700 1 --2- 172.21.15.164:0/3589618068 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 0x7f8a880c4850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.647 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a8e710700 1 -- 172.21.15.164:0/3589618068 >> 172.21.15.164:0/3589618068 conn(0x7f8a880683b0 msgr2=0x7f8a88061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:34.647 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a8e710700 1 -- 172.21.15.164:0/3589618068 shutdown_connections 2020-11-20T11:50:34.647 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.431+0000 7f8a8e710700 1 -- 172.21.15.164:0/3589618068 wait complete. 2020-11-20T11:50:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.432+0000 7f8a8e710700 1 Processor -- start 2020-11-20T11:50:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.432+0000 7f8a8e710700 1 -- start start 2020-11-20T11:50:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a8e710700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 0x7f8a880c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a8e710700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a880bf680 0x7f8a8814bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a8e710700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a880c4470 0x7f8a88160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a8e710700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a88163b20 con 0x7f8a880c4470 2020-11-20T11:50:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a8e710700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a88112d90 con 0x7f8a880bccf0 2020-11-20T11:50:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a8e710700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a88113030 con 0x7f8a880bf680 2020-11-20T11:50:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a87fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 0x7f8a880c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a87fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 0x7f8a880c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45182/0 (socket says 172.21.15.164:45182) 2020-11-20T11:50:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a87fff700 1 -- 172.21.15.164:0/2732027561 learned_addr learned my addr 172.21.15.164:0/2732027561 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a877fe700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a880bf680 0x7f8a8814bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a87fff700 1 -- 172.21.15.164:0/2732027561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a880bf680 msgr2=0x7f8a8814bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a87fff700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a880bf680 0x7f8a8814bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a87fff700 1 -- 172.21.15.164:0/2732027561 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a880c4470 msgr2=0x7f8a88160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a87fff700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a880c4470 0x7f8a88160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a87fff700 1 -- 172.21.15.164:0/2732027561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a88163d50 con 0x7f8a880bccf0 2020-11-20T11:50:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.433+0000 7f8a877fe700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a880bf680 0x7f8a8814bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.434+0000 7f8a87fff700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 0x7f8a880c71c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8a7800c710 tx=0x7f8a78007b10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.434+0000 7f8a67fff700 1 -- 172.21.15.164:0/2732027561 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78007320 con 0x7f8a880bccf0 2020-11-20T11:50:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.434+0000 7f8a67fff700 1 -- 172.21.15.164:0/2732027561 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a78007480 con 0x7f8a880bccf0 2020-11-20T11:50:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.434+0000 7f8a67fff700 1 -- 172.21.15.164:0/2732027561 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78005840 con 0x7f8a880bccf0 2020-11-20T11:50:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.434+0000 7f8a8e710700 1 -- 172.21.15.164:0/2732027561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a88163ff0 con 0x7f8a880bccf0 2020-11-20T11:50:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.434+0000 7f8a8e710700 1 -- 172.21.15.164:0/2732027561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8814c130 con 0x7f8a880bccf0 2020-11-20T11:50:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.435+0000 7f8a8e710700 1 -- 172.21.15.164:0/2732027561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a88164450 con 0x7f8a880bccf0 2020-11-20T11:50:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.435+0000 7f8a67fff700 1 -- 172.21.15.164:0/2732027561 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8a78010030 con 0x7f8a880bccf0 2020-11-20T11:50:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.436+0000 7f8a67fff700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8a60080670 0x7f8a60082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.436+0000 7f8a67fff700 1 -- 172.21.15.164:0/2732027561 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f8a780a21c0 con 0x7f8a880bccf0 2020-11-20T11:50:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.436+0000 7f8a877fe700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8a60080670 0x7f8a60082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.436+0000 7f8a877fe700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8a60080670 0x7f8a60082b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8a7c006fd0 tx=0x7f8a7c015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.439+0000 7f8a67fff700 1 -- 172.21.15.164:0/2732027561 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8a780770f0 con 0x7f8a880bccf0 2020-11-20T11:50:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:34.579+0000 7f8a8e710700 1 -- 172.21.15.164:0/2732027561 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f8a88069b70 con 0x7f8a880bccf0 2020-11-20T11:50:35.256 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.253+0000 7f8a67fff700 1 -- 172.21.15.164:0/2732027561 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v23) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8a7807a710 con 0x7f8a880bccf0 2020-11-20T11:50:35.259 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 -- 172.21.15.164:0/2732027561 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8a60080670 msgr2=0x7f8a60082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:35.260 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8a60080670 0x7f8a60082b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8a7c006fd0 tx=0x7f8a7c015000).stop 2020-11-20T11:50:35.260 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 -- 172.21.15.164:0/2732027561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 msgr2=0x7f8a880c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:35.260 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 0x7f8a880c71c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8a7800c710 tx=0x7f8a78007b10).stop 2020-11-20T11:50:35.260 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 -- 172.21.15.164:0/2732027561 shutdown_connections 2020-11-20T11:50:35.261 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8a60080670 0x7f8a60082b30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:35.261 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880bccf0 0x7f8a880c71c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:35.261 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a880c4470 0x7f8a88160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:35.261 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 --2- 172.21.15.164:0/2732027561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a880bf680 0x7f8a8814bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:35.261 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 -- 172.21.15.164:0/2732027561 >> 172.21.15.164:0/2732027561 conn(0x7f8a880683b0 msgr2=0x7f8a880c21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:35.262 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 -- 172.21.15.164:0/2732027561 shutdown_connections 2020-11-20T11:50:35.262 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.256+0000 7f8a8e710700 1 -- 172.21.15.164:0/2732027561 wait complete. 2020-11-20T11:50:35.262 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'cephfs_metadata' created 2020-11-20T11:50:35.273 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-11-20T11:50:35.274 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-11-20T11:50:35.414 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.411+0000 7f3637fda700 1 Processor -- start 2020-11-20T11:50:35.414 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.411+0000 7f3637fda700 1 -- start start 2020-11-20T11:50:35.418 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.412+0000 7f3637fda700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3630153330 0x7f3630152160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:35.418 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.412+0000 7f3637fda700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36300bd0f0 con 0x7f3630061860 2020-11-20T11:50:35.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.412+0000 7f3637fda700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3630066470 con 0x7f3630061480 2020-11-20T11:50:35.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.412+0000 7f3637fda700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3630061f90 con 0x7f3630153330 2020-11-20T11:50:35.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.412+0000 7f3635575700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f3630061860 0x7f3630152c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:54934/0 (socket says 172.21.15.164:54934) 2020-11-20T11:50:35.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.412+0000 7f3635575700 1 -- 172.21.15.164:0/3360622097 learned_addr learned my addr 172.21.15.164:0/3360622097 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:35.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.412+0000 7f3636577700 1 --2- 172.21.15.164:0/3360622097 >> v2:172.21.15.36:3300/0 conn(0x7f3630153330 0x7f3630152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:35.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.412+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714991784 0 0) 0x7f36300bd0f0 con 0x7f3630061860 2020-11-20T11:50:35.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.412+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3618003280 con 0x7f3630061860 2020-11-20T11:50:35.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.412+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765819662 0 0) 0x7f3630066470 con 0x7f3630061480 2020-11-20T11:50:35.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36300bd0f0 con 0x7f3630061480 2020-11-20T11:50:35.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3307238017 0 0) 0x7f3618003280 con 0x7f3630061860 2020-11-20T11:50:35.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 >> v2:172.21.15.36:3300/0 conn(0x7f3630153330 msgr2=0x7f3630152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:35.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 --2- 172.21.15.164:0/3360622097 >> v2:172.21.15.36:3300/0 conn(0x7f3630153330 0x7f3630152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:35.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 >> v1:172.21.15.188:6789/0 conn(0x7f3630061480 legacy=0x7f36300bc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:35.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630066710 con 0x7f3630061860 2020-11-20T11:50:35.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7f3620001520 con 0x7f3630061860 2020-11-20T11:50:35.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 >> v1:172.21.15.164:6789/0 conn(0x7f3630061860 legacy=0x7f3630152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:35.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3618003950 0x7f3618003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:35.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3618004520 0x7f36180049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:35.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618004e90 0x7f361800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:35.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630061f90 con 0x7f3618004520 2020-11-20T11:50:35.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361800bc60 con 0x7f3618003950 2020-11-20T11:50:35.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361800bda0 con 0x7f3618004e90 2020-11-20T11:50:35.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3635d76700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3618003950 0x7f3618003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:35.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3635575700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3618004520 0x7f36180049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:35.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3636577700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618004e90 0x7f361800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:35.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3635d76700 1 -- 172.21.15.164:0/3360622097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618004e90 msgr2=0x7f361800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:35.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3635d76700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618004e90 0x7f361800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:35.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3635d76700 1 -- 172.21.15.164:0/3360622097 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3618004520 msgr2=0x7f36180049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:35.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3635d76700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3618004520 0x7f36180049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:35.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3635d76700 1 -- 172.21.15.164:0/3360622097 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618003280 con 0x7f3618003950 2020-11-20T11:50:35.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3636577700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618004e90 0x7f361800b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:35.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3635575700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3618004520 0x7f36180049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:35.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3636577700 1 -- 172.21.15.164:0/3360622097 reap_dead start 2020-11-20T11:50:35.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3635d76700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3618003950 0x7f3618003d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f362c001ac0 tx=0x7f362c007bd0).ready entity=mon.1 client_cookie=1cae8ed01d8a58d8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:35.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c007020 con 0x7f3618003950 2020-11-20T11:50:35.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c007180 con 0x7f3618003950 2020-11-20T11:50:35.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.413+0000 7f3634d74700 1 -- 172.21.15.164:0/3360622097 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00c8d0 con 0x7f3618003950 2020-11-20T11:50:35.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.414+0000 7f3637fda700 1 -- 172.21.15.164:0/3360622097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3618003950 msgr2=0x7f3618003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:35.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.414+0000 7f3637fda700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3618003950 0x7f3618003d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f362c001ac0 tx=0x7f362c007bd0).stop 2020-11-20T11:50:35.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.414+0000 7f3637fda700 1 -- 172.21.15.164:0/3360622097 shutdown_connections 2020-11-20T11:50:35.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.414+0000 7f3637fda700 1 --2- 172.21.15.164:0/3360622097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3618003950 0x7f3618003d50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:35.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.414+0000 7f3637fda700 1 -- 172.21.15.164:0/3360622097 >> 172.21.15.164:0/3360622097 conn(0x7f3630065690 msgr2=0x7f36300601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:35.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.414+0000 7f3637fda700 1 -- 172.21.15.164:0/3360622097 shutdown_connections 2020-11-20T11:50:35.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.414+0000 7f3637fda700 1 -- 172.21.15.164:0/3360622097 wait complete. 2020-11-20T11:50:35.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.415+0000 7f3637fda700 1 Processor -- start 2020-11-20T11:50:35.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.415+0000 7f3637fda700 1 -- start start 2020-11-20T11:50:35.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3637fda700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618003950 0x7f36301604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:35.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3637fda700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36300baae0 0x7f3630164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:35.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3637fda700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300b2ec0 0x7f36300b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:35.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3637fda700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300c1df0 con 0x7f36300baae0 2020-11-20T11:50:35.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3637fda700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300bb040 con 0x7f36300b2ec0 2020-11-20T11:50:35.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3637fda700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300bb2e0 con 0x7f3618003950 2020-11-20T11:50:35.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3636577700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300b2ec0 0x7f36300b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:35.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3636577700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300b2ec0 0x7f36300b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45206/0 (socket says 172.21.15.164:45206) 2020-11-20T11:50:35.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3636577700 1 -- 172.21.15.164:0/3867529356 learned_addr learned my addr 172.21.15.164:0/3867529356 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:35.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3635575700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36300baae0 0x7f3630164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:35.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3635d76700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618003950 0x7f36301604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:35.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3636577700 1 -- 172.21.15.164:0/3867529356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618003950 msgr2=0x7f36301604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:35.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3636577700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618003950 0x7f36301604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:35.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3636577700 1 -- 172.21.15.164:0/3867529356 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36300baae0 msgr2=0x7f3630164290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:35.434 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3636577700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36300baae0 0x7f3630164290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:35.434 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3636577700 1 -- 172.21.15.164:0/3867529356 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300bb580 con 0x7f36300b2ec0 2020-11-20T11:50:35.434 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3635575700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36300baae0 0x7f3630164290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:35.434 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3635d76700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618003950 0x7f36301604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:35.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3636577700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300b2ec0 0x7f36300b0ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f36300c3470 tx=0x7f3628008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:35.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f361dffb700 1 -- 172.21.15.164:0/3867529356 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3628015690 con 0x7f36300b2ec0 2020-11-20T11:50:35.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f361dffb700 1 -- 172.21.15.164:0/3867529356 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36280157f0 con 0x7f36300b2ec0 2020-11-20T11:50:35.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f3637fda700 1 -- 172.21.15.164:0/3867529356 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3630163b50 con 0x7f36300b2ec0 2020-11-20T11:50:35.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.416+0000 7f361dffb700 1 -- 172.21.15.164:0/3867529356 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3628015b90 con 0x7f36300b2ec0 2020-11-20T11:50:35.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.417+0000 7f3637fda700 1 -- 172.21.15.164:0/3867529356 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3630164780 con 0x7f36300b2ec0 2020-11-20T11:50:35.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.417+0000 7f360f7fe700 1 -- 172.21.15.164:0/3867529356 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3604004fd0 con 0x7f36300b2ec0 2020-11-20T11:50:35.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.418+0000 7f361dffb700 1 -- 172.21.15.164:0/3867529356 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f362801e030 con 0x7f36300b2ec0 2020-11-20T11:50:35.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.419+0000 7f361dffb700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3608080670 0x7f3608082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:35.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.419+0000 7f361dffb700 1 -- 172.21.15.164:0/3867529356 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f36280a2550 con 0x7f36300b2ec0 2020-11-20T11:50:35.437 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.419+0000 7f3635d76700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3608080670 0x7f3608082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:35.437 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.419+0000 7f3635d76700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3608080670 0x7f3608082b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f362c001ac0 tx=0x7f362c016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:35.437 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.422+0000 7f361dffb700 1 -- 172.21.15.164:0/3867529356 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3628077210 con 0x7f36300b2ec0 2020-11-20T11:50:35.573 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:35.570+0000 7f360f7fe700 1 -- 172.21.15.164:0/3867529356 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f3604003b80 con 0x7f36300b2ec0 2020-11-20T11:50:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.265+0000 7f361dffb700 1 -- 172.21.15.164:0/3867529356 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 154+0+0 (secure 0 0 0) 0x7f362807a830 con 0x7f36300b2ec0 2020-11-20T11:50:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.267+0000 7f360f7fe700 1 -- 172.21.15.164:0/3867529356 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3608080670 msgr2=0x7f3608082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.267+0000 7f360f7fe700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3608080670 0x7f3608082b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f362c001ac0 tx=0x7f362c016000).stop 2020-11-20T11:50:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.267+0000 7f360f7fe700 1 -- 172.21.15.164:0/3867529356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300b2ec0 msgr2=0x7f36300b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.267+0000 7f360f7fe700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300b2ec0 0x7f36300b0ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f36300c3470 tx=0x7f3628008040).stop 2020-11-20T11:50:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.268+0000 7f360f7fe700 1 -- 172.21.15.164:0/3867529356 shutdown_connections 2020-11-20T11:50:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.268+0000 7f360f7fe700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3608080670 0x7f3608082b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.268+0000 7f360f7fe700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300b2ec0 0x7f36300b0ff0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.268+0000 7f360f7fe700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3618003950 0x7f36301604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.268+0000 7f360f7fe700 1 --2- 172.21.15.164:0/3867529356 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36300baae0 0x7f3630164290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.268+0000 7f360f7fe700 1 -- 172.21.15.164:0/3867529356 >> 172.21.15.164:0/3867529356 conn(0x7f3630065690 msgr2=0x7f363014e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.268+0000 7f360f7fe700 1 -- 172.21.15.164:0/3867529356 shutdown_connections 2020-11-20T11:50:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.268+0000 7f360f7fe700 1 -- 172.21.15.164:0/3867529356 wait complete. 2020-11-20T11:50:36.289 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2020-11-20T11:50:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.438+0000 7ff6685d9700 1 Processor -- start 2020-11-20T11:50:36.441 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.438+0000 7ff6685d9700 1 -- start start 2020-11-20T11:50:36.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.438+0000 7ff6685d9700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff66009f5e0 0x7ff660150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:36.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff6685d9700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6600631f0 con 0x7ff66009d540 2020-11-20T11:50:36.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff6685d9700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff660154c50 con 0x7ff66009d160 2020-11-20T11:50:36.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff6685d9700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff660154ef0 con 0x7ff66009f5e0 2020-11-20T11:50:36.444 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff665b74700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff66009d540 0x7ff66009eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.164:41082/0 (socket says 172.21.15.164:41082) 2020-11-20T11:50:36.444 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff665b74700 1 -- 172.21.15.164:0/1736332674 learned_addr learned my addr 172.21.15.164:0/1736332674 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:36.444 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff666b76700 1 --2- 172.21.15.164:0/1736332674 >> v2:172.21.15.188:3300/0 conn(0x7ff66009f5e0 0x7ff660150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:36.444 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff665373700 1 -- 172.21.15.164:0/1736332674 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010128320 0 0) 0x7ff6600631f0 con 0x7ff66009d540 2020-11-20T11:50:36.444 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff665373700 1 -- 172.21.15.164:0/1736332674 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff648003280 con 0x7ff66009d540 2020-11-20T11:50:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff666b76700 1 -- 172.21.15.164:0/1736332674 >> v1:172.21.15.188:6789/0 conn(0x7ff66009d160 legacy=0x7ff660062ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff666b76700 1 -- 172.21.15.164:0/1736332674 >> v1:172.21.15.36:6789/0 conn(0x7ff66009d540 legacy=0x7ff66009eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff666b76700 1 -- 172.21.15.164:0/1736332674 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff660155190 con 0x7ff66009f5e0 2020-11-20T11:50:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.439+0000 7ff666b76700 1 --2- 172.21.15.164:0/1736332674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff66009f5e0 0x7ff660150ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff658009ce0 tx=0x7ff658009220).ready entity=mon.2 client_cookie=b156831308175f96 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.440+0000 7ff665373700 1 -- 172.21.15.164:0/1736332674 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65800bad0 con 0x7ff66009f5e0 2020-11-20T11:50:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.440+0000 7ff665373700 1 -- 172.21.15.164:0/1736332674 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65800bc30 con 0x7ff66009f5e0 2020-11-20T11:50:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.440+0000 7ff665373700 1 -- 172.21.15.164:0/1736332674 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658011400 con 0x7ff66009f5e0 2020-11-20T11:50:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.440+0000 7ff6685d9700 1 -- 172.21.15.164:0/1736332674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff66009f5e0 msgr2=0x7ff660150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.440+0000 7ff6685d9700 1 --2- 172.21.15.164:0/1736332674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff66009f5e0 0x7ff660150ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff658009ce0 tx=0x7ff658009220).stop 2020-11-20T11:50:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.440+0000 7ff6685d9700 1 -- 172.21.15.164:0/1736332674 shutdown_connections 2020-11-20T11:50:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.440+0000 7ff6685d9700 1 --2- 172.21.15.164:0/1736332674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff66009f5e0 0x7ff660150ff0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.440+0000 7ff6685d9700 1 -- 172.21.15.164:0/1736332674 >> 172.21.15.164:0/1736332674 conn(0x7ff6600678e0 msgr2=0x7ff660067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.440+0000 7ff6685d9700 1 -- 172.21.15.164:0/1736332674 shutdown_connections 2020-11-20T11:50:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.440+0000 7ff6685d9700 1 -- 172.21.15.164:0/1736332674 wait complete. 2020-11-20T11:50:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.441+0000 7ff6685d9700 1 Processor -- start 2020-11-20T11:50:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.441+0000 7ff6685d9700 1 -- start start 2020-11-20T11:50:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff6685d9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff66009d160 0x7ff6600be980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff6685d9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff66009d540 0x7ff66014fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff6685d9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff66009f5e0 0x7ff660150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff6685d9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600c6920 con 0x7ff66009d540 2020-11-20T11:50:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff6685d9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600c5b80 con 0x7ff66009d160 2020-11-20T11:50:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff6685d9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600c5e20 con 0x7ff66009f5e0 2020-11-20T11:50:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff666375700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff66009d160 0x7ff6600be980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff666375700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff66009d160 0x7ff6600be980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45216/0 (socket says 172.21.15.164:45216) 2020-11-20T11:50:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff666375700 1 -- 172.21.15.164:0/2492282533 learned_addr learned my addr 172.21.15.164:0/2492282533 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff666b76700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff66009f5e0 0x7ff660150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.442+0000 7ff665b74700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff66009d540 0x7ff66014fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff666375700 1 -- 172.21.15.164:0/2492282533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff66009f5e0 msgr2=0x7ff660150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff666375700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff66009f5e0 0x7ff660150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff666375700 1 -- 172.21.15.164:0/2492282533 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff66009d540 msgr2=0x7ff66014fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff666375700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff66009d540 0x7ff66014fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff666375700 1 -- 172.21.15.164:0/2492282533 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600c60c0 con 0x7ff66009d160 2020-11-20T11:50:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff666b76700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff66009f5e0 0x7ff660150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff665b74700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff66009d540 0x7ff66014fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff666375700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff66009d160 0x7ff6600be980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ff65c00c710 tx=0x7ff65c007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff64e7fc700 1 -- 172.21.15.164:0/2492282533 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c010510 con 0x7ff66009d160 2020-11-20T11:50:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff64e7fc700 1 -- 172.21.15.164:0/2492282533 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c010670 con 0x7ff66009d160 2020-11-20T11:50:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff6685d9700 1 -- 172.21.15.164:0/2492282533 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6600c6360 con 0x7ff66009d160 2020-11-20T11:50:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff64e7fc700 1 -- 172.21.15.164:0/2492282533 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c010a10 con 0x7ff66009d160 2020-11-20T11:50:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.443+0000 7ff6685d9700 1 -- 172.21.15.164:0/2492282533 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff660161230 con 0x7ff66009d160 2020-11-20T11:50:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.444+0000 7ff6685d9700 1 -- 172.21.15.164:0/2492282533 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6600c6a90 con 0x7ff66009d160 2020-11-20T11:50:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.444+0000 7ff64e7fc700 1 -- 172.21.15.164:0/2492282533 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff65c010070 con 0x7ff66009d160 2020-11-20T11:50:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.445+0000 7ff64e7fc700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff638080670 0x7ff638082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:36.458 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.445+0000 7ff665b74700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff638080670 0x7ff638082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:36.458 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.445+0000 7ff64e7fc700 1 -- 172.21.15.164:0/2492282533 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7703+0+0 (secure 0 0 0) 0x7ff65c0a21d0 con 0x7ff66009d160 2020-11-20T11:50:36.459 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.445+0000 7ff665b74700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff638080670 0x7ff638082b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff66009cf30 tx=0x7ff650009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:36.459 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.448+0000 7ff64e7fc700 1 -- 172.21.15.164:0/2492282533 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff65c076ea0 con 0x7ff66009d160 2020-11-20T11:50:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:36.588+0000 7ff6685d9700 1 -- 172.21.15.164:0/2492282533 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7ff660069b70 con 0x7ff66009d160 2020-11-20T11:50:38.272 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.269+0000 7ff64e7fc700 1 -- 172.21.15.164:0/2492282533 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v26) v1 ==== 188+0+0 (secure 0 0 0) 0x7ff65c07a4c0 con 0x7ff66009d160 2020-11-20T11:50:38.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.274+0000 7ff6685d9700 1 -- 172.21.15.164:0/2492282533 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff638080670 msgr2=0x7ff638082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:38.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.274+0000 7ff6685d9700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff638080670 0x7ff638082b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff66009cf30 tx=0x7ff650009040).stop 2020-11-20T11:50:38.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.274+0000 7ff6685d9700 1 -- 172.21.15.164:0/2492282533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff66009d160 msgr2=0x7ff6600be980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:38.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.274+0000 7ff6685d9700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff66009d160 0x7ff6600be980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ff65c00c710 tx=0x7ff65c007c40).stop 2020-11-20T11:50:38.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.275+0000 7ff6685d9700 1 -- 172.21.15.164:0/2492282533 shutdown_connections 2020-11-20T11:50:38.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.275+0000 7ff6685d9700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff638080670 0x7ff638082b30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:38.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.275+0000 7ff6685d9700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff66009d160 0x7ff6600be980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:38.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.275+0000 7ff6685d9700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff66009f5e0 0x7ff660150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:38.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.275+0000 7ff6685d9700 1 --2- 172.21.15.164:0/2492282533 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff66009d540 0x7ff66014fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:38.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.275+0000 7ff6685d9700 1 -- 172.21.15.164:0/2492282533 >> 172.21.15.164:0/2492282533 conn(0x7ff6600678e0 msgr2=0x7ff66014a280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:38.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.275+0000 7ff6685d9700 1 -- 172.21.15.164:0/2492282533 shutdown_connections 2020-11-20T11:50:38.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.275+0000 7ff6685d9700 1 -- 172.21.15.164:0/2492282533 wait complete. 2020-11-20T11:50:38.280 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'cephfs_data' created 2020-11-20T11:50:38.293 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2020-11-20T11:50:38.411 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.409+0000 7fe4e49e8700 1 Processor -- start 2020-11-20T11:50:38.412 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.409+0000 7fe4e49e8700 1 -- start start 2020-11-20T11:50:38.415 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.410+0000 7fe4e49e8700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe4e0061480 0x7fe4e0061860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:38.415 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.410+0000 7fe4e49e8700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e0066470 con 0x7fe4e00bc9e0 2020-11-20T11:50:38.415 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.410+0000 7fe4e49e8700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e0066710 con 0x7fe4e00bce40 2020-11-20T11:50:38.416 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.410+0000 7fe4e49e8700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e0061f90 con 0x7fe4e0061480 2020-11-20T11:50:38.416 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.410+0000 7fe4ddd9b700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fe4e00bc9e0 0x7fe4e0152c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:54968/0 (socket says 172.21.15.164:54968) 2020-11-20T11:50:38.416 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.410+0000 7fe4ddd9b700 1 -- 172.21.15.164:0/1190055538 learned_addr learned my addr 172.21.15.164:0/1190055538 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:38.416 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.410+0000 7fe4de59c700 1 --2- 172.21.15.164:0/1190055538 >> v2:172.21.15.188:3300/0 conn(0x7fe4e0061480 0x7fe4e0061860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:38.416 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.410+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598453704 0 0) 0x7fe4e0066470 con 0x7fe4e00bc9e0 2020-11-20T11:50:38.417 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.410+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c4003280 con 0x7fe4e00bc9e0 2020-11-20T11:50:38.417 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8435573 0 0) 0x7fe4e0066710 con 0x7fe4e00bce40 2020-11-20T11:50:38.417 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e0066470 con 0x7fe4e00bce40 2020-11-20T11:50:38.417 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 912504836 0 0) 0x7fe4c4003280 con 0x7fe4e00bc9e0 2020-11-20T11:50:38.417 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 >> v2:172.21.15.188:3300/0 conn(0x7fe4e0061480 msgr2=0x7fe4e0061860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:38.418 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 --2- 172.21.15.164:0/1190055538 >> v2:172.21.15.188:3300/0 conn(0x7fe4e0061480 0x7fe4e0061860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:38.418 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 >> v1:172.21.15.188:6789/0 conn(0x7fe4e00bce40 legacy=0x7fe4e0151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:38.418 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e00669b0 con 0x7fe4e00bc9e0 2020-11-20T11:50:38.418 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fe4d4001520 con 0x7fe4e00bc9e0 2020-11-20T11:50:38.418 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 >> v1:172.21.15.164:6789/0 conn(0x7fe4e00bc9e0 legacy=0x7fe4e0152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:38.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 --2- 172.21.15.164:0/1190055538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4c4003950 0x7fe4c4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:38.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 --2- 172.21.15.164:0/1190055538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c4004520 0x7fe4c40049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:38.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 --2- 172.21.15.164:0/1190055538 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4c4004e90 0x7fe4c400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:38.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0061f90 con 0x7fe4c4004e90 2020-11-20T11:50:38.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c400bc60 con 0x7fe4c4004520 2020-11-20T11:50:38.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c400bda0 con 0x7fe4c4003950 2020-11-20T11:50:38.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4ddd9b700 1 --2- 172.21.15.164:0/1190055538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c4004520 0x7fe4c40049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:38.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4de59c700 1 --2- 172.21.15.164:0/1190055538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4c4003950 0x7fe4c4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:38.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4ddd9b700 1 -- 172.21.15.164:0/1190055538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4c4003950 msgr2=0x7fe4c4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:38.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4ddd9b700 1 --2- 172.21.15.164:0/1190055538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4c4003950 0x7fe4c4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:38.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4ddd9b700 1 -- 172.21.15.164:0/1190055538 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4c4004e90 msgr2=0x7fe4c400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:38.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4ddd9b700 1 --2- 172.21.15.164:0/1190055538 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4c4004e90 0x7fe4c400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:38.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4ddd9b700 1 -- 172.21.15.164:0/1190055538 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c4003280 con 0x7fe4c4004520 2020-11-20T11:50:38.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4ded9d700 1 -- 172.21.15.164:0/1190055538 reap_dead start 2020-11-20T11:50:38.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4ddd9b700 1 --2- 172.21.15.164:0/1190055538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c4004520 0x7fe4c40049a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe4d400c440 tx=0x7fe4e0066600).ready entity=mon.1 client_cookie=e6a507af1ea6844e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:38.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40070d0 con 0x7fe4c4004520 2020-11-20T11:50:38.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4007230 con 0x7fe4c4004520 2020-11-20T11:50:38.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.411+0000 7fe4dd59a700 1 -- 172.21.15.164:0/1190055538 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4005630 con 0x7fe4c4004520 2020-11-20T11:50:38.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.412+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1190055538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c4004520 msgr2=0x7fe4c40049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:38.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.412+0000 7fe4e49e8700 1 --2- 172.21.15.164:0/1190055538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c4004520 0x7fe4c40049a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe4d400c440 tx=0x7fe4e0066600).stop 2020-11-20T11:50:38.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.412+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1190055538 shutdown_connections 2020-11-20T11:50:38.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.412+0000 7fe4e49e8700 1 --2- 172.21.15.164:0/1190055538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c4004520 0x7fe4c40049a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:38.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.412+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1190055538 >> 172.21.15.164:0/1190055538 conn(0x7fe4e0065690 msgr2=0x7fe4e00601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:38.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.412+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1190055538 shutdown_connections 2020-11-20T11:50:38.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.412+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1190055538 wait complete. 2020-11-20T11:50:38.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.413+0000 7fe4e49e8700 1 Processor -- start 2020-11-20T11:50:38.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.413+0000 7fe4e49e8700 1 -- start start 2020-11-20T11:50:38.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4e49e8700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4c4004520 0x7fe4e01647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:38.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4e49e8700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4e0158020 0x7fe4e00b9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:38.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4e49e8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4e0158480 0x7fe4e00b9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:38.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4e49e8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00bfa60 con 0x7fe4e0158480 2020-11-20T11:50:38.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4e49e8700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e01608b0 con 0x7fe4e0158020 2020-11-20T11:50:38.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4e49e8700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0160b50 con 0x7fe4c4004520 2020-11-20T11:50:38.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ddd9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4e0158020 0x7fe4e00b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:38.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ddd9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4e0158020 0x7fe4e00b9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45242/0 (socket says 172.21.15.164:45242) 2020-11-20T11:50:38.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ddd9b700 1 -- 172.21.15.164:0/1523130617 learned_addr learned my addr 172.21.15.164:0/1523130617 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:38.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ded9d700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4e0158480 0x7fe4e00b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:38.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ddd9b700 1 -- 172.21.15.164:0/1523130617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4c4004520 msgr2=0x7fe4e01647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:38.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ddd9b700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4c4004520 0x7fe4e01647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:38.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ddd9b700 1 -- 172.21.15.164:0/1523130617 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4e0158480 msgr2=0x7fe4e00b9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:38.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ddd9b700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4e0158480 0x7fe4e00b9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:38.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ddd9b700 1 -- 172.21.15.164:0/1523130617 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0160df0 con 0x7fe4e0158020 2020-11-20T11:50:38.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ded9d700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4e0158480 0x7fe4e00b9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:38.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ddd9b700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4e0158020 0x7fe4e00b9480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe4d400cae0 tx=0x7fe4d4013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:38.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ce7fc700 1 -- 172.21.15.164:0/1523130617 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40073a0 con 0x7fe4e0158020 2020-11-20T11:50:38.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ce7fc700 1 -- 172.21.15.164:0/1523130617 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4007500 con 0x7fe4e0158020 2020-11-20T11:50:38.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4ce7fc700 1 -- 172.21.15.164:0/1523130617 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4013680 con 0x7fe4e0158020 2020-11-20T11:50:38.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1523130617 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e0161090 con 0x7fe4e0158020 2020-11-20T11:50:38.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.414+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1523130617 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e01615d0 con 0x7fe4e0158020 2020-11-20T11:50:38.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.415+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1523130617 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e0164d20 con 0x7fe4e0158020 2020-11-20T11:50:38.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.416+0000 7fe4ce7fc700 1 -- 172.21.15.164:0/1523130617 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe4d401c020 con 0x7fe4e0158020 2020-11-20T11:50:38.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.416+0000 7fe4ce7fc700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe4b80806a0 0x7fe4b8082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:38.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.416+0000 7fe4ce7fc700 1 -- 172.21.15.164:0/1523130617 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 8155+0+0 (secure 0 0 0) 0x7fe4d40a37e0 con 0x7fe4e0158020 2020-11-20T11:50:38.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.416+0000 7fe4de59c700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe4b80806a0 0x7fe4b8082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:38.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.417+0000 7fe4de59c700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe4b80806a0 0x7fe4b8082b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe4d0006fd0 tx=0x7fe4d0006e30).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:38.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.420+0000 7fe4ce7fc700 1 -- 172.21.15.164:0/1523130617 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe4d40781e0 con 0x7fe4e0158020 2020-11-20T11:50:38.565 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:38.562+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1523130617 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fe4e00634d0 con 0x7fe4e0158020 2020-11-20T11:50:39.273 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.271+0000 7fe4ce7fc700 1 -- 172.21.15.164:0/1523130617 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v27) v1 ==== 166+0+0 (secure 0 0 0) 0x7fe4d407b800 con 0x7fe4e0158020 2020-11-20T11:50:39.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.276+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1523130617 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe4b80806a0 msgr2=0x7fe4b8082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.276+0000 7fe4e49e8700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe4b80806a0 0x7fe4b8082b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe4d0006fd0 tx=0x7fe4d0006e30).stop 2020-11-20T11:50:39.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.276+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1523130617 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4e0158020 msgr2=0x7fe4e00b9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.276+0000 7fe4e49e8700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4e0158020 0x7fe4e00b9480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe4d400cae0 tx=0x7fe4d4013000).stop 2020-11-20T11:50:39.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.276+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1523130617 shutdown_connections 2020-11-20T11:50:39.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.276+0000 7fe4e49e8700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe4b80806a0 0x7fe4b8082b60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.276+0000 7fe4e49e8700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4e0158480 0x7fe4e00b9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.276+0000 7fe4e49e8700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4c4004520 0x7fe4e01647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:39.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.276+0000 7fe4e49e8700 1 --2- 172.21.15.164:0/1523130617 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4e0158020 0x7fe4e00b9480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.276+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1523130617 >> 172.21.15.164:0/1523130617 conn(0x7fe4e0065690 msgr2=0x7fe4e00c3470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:39.282 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.277+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1523130617 shutdown_connections 2020-11-20T11:50:39.282 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.277+0000 7fe4e49e8700 1 -- 172.21.15.164:0/1523130617 wait complete. 2020-11-20T11:50:39.282 INFO:teuthology.orchestra.run.smithi164.stderr:set pool 4 allow_ec_overwrites to true 2020-11-20T11:50:39.295 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2020-11-20T11:50:39.418 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.415+0000 7faa2ac79700 1 Processor -- start 2020-11-20T11:50:39.418 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.415+0000 7faa2ac79700 1 -- start start 2020-11-20T11:50:39.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.416+0000 7faa2ac79700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faa24061d70 0x7faa240c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.416+0000 7faa2ac79700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faa24060960 0x7faa2409e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.416+0000 7faa2ac79700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2409eee0 con 0x7faa240c76c0 2020-11-20T11:50:39.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.416+0000 7faa2ac79700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa240610f0 con 0x7faa24060960 2020-11-20T11:50:39.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.416+0000 7faa2ac79700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa24061390 con 0x7faa24061d70 2020-11-20T11:50:39.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.416+0000 7faa29476700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faa24061d70 0x7faa240c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.416+0000 7faa2a478700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faa24060960 0x7faa2409e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.416+0000 7faa29476700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faa24061d70 0x7faa240c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.164:38516/0 (socket says 172.21.15.164:38516) 2020-11-20T11:50:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.416+0000 7faa29c77700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7faa240c76c0 0x7faa24152410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.164:40308/0 (socket says 172.21.15.164:40308) 2020-11-20T11:50:39.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.416+0000 7faa29476700 1 -- 172.21.15.164:0/3031460228 learned_addr learned my addr 172.21.15.164:0/3031460228 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:39.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.417+0000 7faa29476700 1 -- 172.21.15.164:0/3031460228 >> v2:172.21.15.36:3300/0 conn(0x7faa24060960 msgr2=0x7faa2409e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:39.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.417+0000 7faa29476700 1 --2- 172.21.15.164:0/3031460228 >> v2:172.21.15.36:3300/0 conn(0x7faa24060960 0x7faa2409e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.417+0000 7faa29476700 1 -- 172.21.15.164:0/3031460228 >> v1:172.21.15.188:6789/0 conn(0x7faa240c76c0 legacy=0x7faa24152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.417+0000 7faa28c75700 1 -- 172.21.15.164:0/3031460228 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261746164 0 0) 0x7faa2409eee0 con 0x7faa240c76c0 2020-11-20T11:50:39.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.417+0000 7faa29476700 1 -- 172.21.15.164:0/3031460228 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa24061630 con 0x7faa24061d70 2020-11-20T11:50:39.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.417+0000 7faa2a478700 1 --2- 172.21.15.164:0/3031460228 >> v2:172.21.15.36:3300/0 conn(0x7faa24060960 0x7faa2409e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:39.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.417+0000 7faa29476700 1 --2- 172.21.15.164:0/3031460228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa24061d70 0x7faa240c7aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7faa24060650 tx=0x7faa14006ef0).ready entity=mon.2 client_cookie=88e0d9bd206cff94 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:39.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.417+0000 7faa28c75700 1 -- 172.21.15.164:0/3031460228 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1400b860 con 0x7faa24061d70 2020-11-20T11:50:39.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.417+0000 7faa28c75700 1 -- 172.21.15.164:0/3031460228 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa14000e90 con 0x7faa24061d70 2020-11-20T11:50:39.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.417+0000 7faa28c75700 1 -- 172.21.15.164:0/3031460228 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1400bbd0 con 0x7faa24061d70 2020-11-20T11:50:39.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.418+0000 7faa2ac79700 1 -- 172.21.15.164:0/3031460228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa24061d70 msgr2=0x7faa240c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.418+0000 7faa2ac79700 1 --2- 172.21.15.164:0/3031460228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa24061d70 0x7faa240c7aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7faa24060650 tx=0x7faa14006ef0).stop 2020-11-20T11:50:39.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.418+0000 7faa2ac79700 1 -- 172.21.15.164:0/3031460228 shutdown_connections 2020-11-20T11:50:39.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.418+0000 7faa2ac79700 1 --2- 172.21.15.164:0/3031460228 >> v2:172.21.15.36:3300/0 conn(0x7faa24060960 0x7faa2409e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.418+0000 7faa2ac79700 1 --2- 172.21.15.164:0/3031460228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa24061d70 0x7faa240c7aa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.418+0000 7faa2ac79700 1 -- 172.21.15.164:0/3031460228 >> 172.21.15.164:0/3031460228 conn(0x7faa2407ffb0 msgr2=0x7faa240803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:39.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.418+0000 7faa2ac79700 1 -- 172.21.15.164:0/3031460228 shutdown_connections 2020-11-20T11:50:39.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.418+0000 7faa2ac79700 1 -- 172.21.15.164:0/3031460228 wait complete. 2020-11-20T11:50:39.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.419+0000 7faa2ac79700 1 Processor -- start 2020-11-20T11:50:39.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.419+0000 7faa2ac79700 1 -- start start 2020-11-20T11:50:39.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.419+0000 7faa2ac79700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa24060960 0x7faa2414fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.419+0000 7faa2ac79700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa24061d70 0x7faa24150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.419+0000 7faa2ac79700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa240c76c0 0x7faa24163fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.419+0000 7faa2ac79700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2414f810 con 0x7faa24061d70 2020-11-20T11:50:39.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.419+0000 7faa2ac79700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa24157450 con 0x7faa240c76c0 2020-11-20T11:50:39.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.419+0000 7faa2ac79700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa24153ac0 con 0x7faa24060960 2020-11-20T11:50:39.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2a478700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa240c76c0 0x7faa24163fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2a478700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa240c76c0 0x7faa24163fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45262/0 (socket says 172.21.15.164:45262) 2020-11-20T11:50:39.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2a478700 1 -- 172.21.15.164:0/4220426117 learned_addr learned my addr 172.21.15.164:0/4220426117 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:39.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa29c77700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa24060960 0x7faa2414fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa29476700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa24061d70 0x7faa24150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2a478700 1 -- 172.21.15.164:0/4220426117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa24060960 msgr2=0x7faa2414fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2a478700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa24060960 0x7faa2414fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2a478700 1 -- 172.21.15.164:0/4220426117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa24061d70 msgr2=0x7faa24150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2a478700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa24061d70 0x7faa24150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2a478700 1 -- 172.21.15.164:0/4220426117 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa241576b0 con 0x7faa240c76c0 2020-11-20T11:50:39.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2a478700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa240c76c0 0x7faa24163fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7faa1c00efb0 tx=0x7faa1c009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:39.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa11ffb700 1 -- 172.21.15.164:0/4220426117 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00cc60 con 0x7faa240c76c0 2020-11-20T11:50:39.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa11ffb700 1 -- 172.21.15.164:0/4220426117 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c00cdc0 con 0x7faa240c76c0 2020-11-20T11:50:39.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2ac79700 1 -- 172.21.15.164:0/4220426117 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa24157950 con 0x7faa240c76c0 2020-11-20T11:50:39.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa11ffb700 1 -- 172.21.15.164:0/4220426117 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c012620 con 0x7faa240c76c0 2020-11-20T11:50:39.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.420+0000 7faa2ac79700 1 -- 172.21.15.164:0/4220426117 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa24151ad0 con 0x7faa240c76c0 2020-11-20T11:50:39.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.421+0000 7faa2ac79700 1 -- 172.21.15.164:0/4220426117 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2414f950 con 0x7faa240c76c0 2020-11-20T11:50:39.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.422+0000 7faa11ffb700 1 -- 172.21.15.164:0/4220426117 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7faa1c022070 con 0x7faa240c76c0 2020-11-20T11:50:39.434 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.422+0000 7faa11ffb700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9fc080670 0x7fa9fc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.423+0000 7faa29c77700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9fc080670 0x7fa9fc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.423+0000 7faa11ffb700 1 -- 172.21.15.164:0/4220426117 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 8155+0+0 (secure 0 0 0) 0x7faa1c0a31d0 con 0x7faa240c76c0 2020-11-20T11:50:39.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.423+0000 7faa29c77700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9fc080670 0x7fa9fc082b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7faa20004740 tx=0x7faa20007c00).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:39.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.426+0000 7faa11ffb700 1 -- 172.21.15.164:0/4220426117 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7faa1c077ce0 con 0x7faa240c76c0 2020-11-20T11:50:39.613 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.611+0000 7faa2ac79700 1 -- 172.21.15.164:0/4220426117 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7faa24164cb0 con 0x7faa240c76c0 2020-11-20T11:50:39.621 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.619+0000 7faa11ffb700 1 -- 172.21.15.164:0/4220426117 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v5) v1 ==== 187+0+0 (secure 0 0 0) 0x7faa1c016030 con 0x7faa240c76c0 2020-11-20T11:50:39.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 -- 172.21.15.164:0/4220426117 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9fc080670 msgr2=0x7fa9fc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9fc080670 0x7fa9fc082b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7faa20004740 tx=0x7faa20007c00).stop 2020-11-20T11:50:39.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 -- 172.21.15.164:0/4220426117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa240c76c0 msgr2=0x7faa24163fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa240c76c0 0x7faa24163fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7faa1c00efb0 tx=0x7faa1c009220).stop 2020-11-20T11:50:39.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 -- 172.21.15.164:0/4220426117 shutdown_connections 2020-11-20T11:50:39.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9fc080670 0x7fa9fc082b30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa240c76c0 0x7faa24163fd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa24060960 0x7faa2414fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 --2- 172.21.15.164:0/4220426117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa24061d70 0x7faa24150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 -- 172.21.15.164:0/4220426117 >> 172.21.15.164:0/4220426117 conn(0x7faa2407ffb0 msgr2=0x7faa2409e700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:39.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.621+0000 7faa2ac79700 1 -- 172.21.15.164:0/4220426117 shutdown_connections 2020-11-20T11:50:39.627 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.622+0000 7faa2ac79700 1 -- 172.21.15.164:0/4220426117 wait complete. 2020-11-20T11:50:39.627 INFO:teuthology.orchestra.run.smithi164.stderr:new fs with metadata pool 3 and data pool 4 2020-11-20T11:50:39.640 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:39.753 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.750+0000 7f3a3f923700 1 Processor -- start 2020-11-20T11:50:39.755 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.750+0000 7f3a3f923700 1 -- start start 2020-11-20T11:50:39.756 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3f923700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3a380c4360 0x7f3a380c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.756 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3f923700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3a381550f0 0x7f3a380bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.756 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3f923700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3a380bff10 0x7f3a38150520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.756 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3f923700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a380bd090 con 0x7f3a380bff10 2020-11-20T11:50:39.756 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3f923700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a38151220 con 0x7f3a381550f0 2020-11-20T11:50:39.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3f923700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a381514c0 con 0x7f3a380c4360 2020-11-20T11:50:39.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3cebe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3a381550f0 0x7f3a380bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3cebe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3a381550f0 0x7f3a380bfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45270/0 (socket says 172.21.15.164:45270) 2020-11-20T11:50:39.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3cebe700 1 -- 172.21.15.164:0/3421551884 learned_addr learned my addr 172.21.15.164:0/3421551884 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:39.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3dec0700 1 --2- 172.21.15.164:0/3421551884 >> v2:172.21.15.36:3300/0 conn(0x7f3a380bff10 0x7f3a38150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3cebe700 1 -- 172.21.15.164:0/3421551884 >> v2:172.21.15.188:3300/0 conn(0x7f3a380c4360 msgr2=0x7f3a380c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:39.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3d6bf700 1 --2- 172.21.15.164:0/3421551884 >> v2:172.21.15.188:3300/0 conn(0x7f3a380c4360 0x7f3a380c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3cebe700 1 --2- 172.21.15.164:0/3421551884 >> v2:172.21.15.188:3300/0 conn(0x7f3a380c4360 0x7f3a380c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3cebe700 1 -- 172.21.15.164:0/3421551884 >> v2:172.21.15.36:3300/0 conn(0x7f3a380bff10 msgr2=0x7f3a38150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:39.759 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.751+0000 7f3a3cebe700 1 --2- 172.21.15.164:0/3421551884 >> v2:172.21.15.36:3300/0 conn(0x7f3a380bff10 0x7f3a38150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.759 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3cebe700 1 -- 172.21.15.164:0/3421551884 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a38151760 con 0x7f3a381550f0 2020-11-20T11:50:39.759 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3dec0700 1 --2- 172.21.15.164:0/3421551884 >> v2:172.21.15.36:3300/0 conn(0x7f3a380bff10 0x7f3a38150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:39.759 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3d6bf700 1 --2- 172.21.15.164:0/3421551884 >> v2:172.21.15.188:3300/0 conn(0x7f3a380c4360 0x7f3a380c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:39.759 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3cebe700 1 --2- 172.21.15.164:0/3421551884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a381550f0 0x7f3a380bfa20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3a38063380 tx=0x7f3a28006ef0).ready entity=mon.1 client_cookie=86251b1d439c0286 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:39.760 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a27fff700 1 -- 172.21.15.164:0/3421551884 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2800b830 con 0x7f3a381550f0 2020-11-20T11:50:39.760 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a27fff700 1 -- 172.21.15.164:0/3421551884 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a28000e90 con 0x7f3a381550f0 2020-11-20T11:50:39.760 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a27fff700 1 -- 172.21.15.164:0/3421551884 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2800bba0 con 0x7f3a381550f0 2020-11-20T11:50:39.760 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3f923700 1 -- 172.21.15.164:0/3421551884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a381550f0 msgr2=0x7f3a380bfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.760 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3f923700 1 --2- 172.21.15.164:0/3421551884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a381550f0 0x7f3a380bfa20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3a38063380 tx=0x7f3a28006ef0).stop 2020-11-20T11:50:39.761 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3f923700 1 -- 172.21.15.164:0/3421551884 shutdown_connections 2020-11-20T11:50:39.761 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3f923700 1 --2- 172.21.15.164:0/3421551884 >> v2:172.21.15.36:3300/0 conn(0x7f3a380bff10 0x7f3a38150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.761 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3f923700 1 --2- 172.21.15.164:0/3421551884 >> v2:172.21.15.188:3300/0 conn(0x7f3a380c4360 0x7f3a380c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.761 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3f923700 1 --2- 172.21.15.164:0/3421551884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a381550f0 0x7f3a380bfa20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.761 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3f923700 1 -- 172.21.15.164:0/3421551884 >> 172.21.15.164:0/3421551884 conn(0x7f3a380619e0 msgr2=0x7f3a38061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:39.762 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3f923700 1 -- 172.21.15.164:0/3421551884 shutdown_connections 2020-11-20T11:50:39.762 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.752+0000 7f3a3f923700 1 -- 172.21.15.164:0/3421551884 wait complete. 2020-11-20T11:50:39.765 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.753+0000 7f3a3f923700 1 Processor -- start 2020-11-20T11:50:39.765 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.753+0000 7f3a3f923700 1 -- start start 2020-11-20T11:50:39.765 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.754+0000 7f3a3f923700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a380bff10 0x7f3a3814bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.765 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.754+0000 7f3a3f923700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a380c4360 0x7f3a38112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.754+0000 7f3a3f923700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a381550f0 0x7f3a38112840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.754+0000 7f3a3f923700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a38155f90 con 0x7f3a380c4360 2020-11-20T11:50:39.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.754+0000 7f3a3f923700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a38156230 con 0x7f3a380bff10 2020-11-20T11:50:39.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.754+0000 7f3a3f923700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a381564d0 con 0x7f3a381550f0 2020-11-20T11:50:39.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.754+0000 7f3a3d6bf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a380bff10 0x7f3a3814bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3d6bf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a380bff10 0x7f3a3814bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45272/0 (socket says 172.21.15.164:45272) 2020-11-20T11:50:39.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3d6bf700 1 -- 172.21.15.164:0/3113909259 learned_addr learned my addr 172.21.15.164:0/3113909259 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:39.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3cebe700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a380c4360 0x7f3a38112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3dec0700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a381550f0 0x7f3a38112840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3d6bf700 1 -- 172.21.15.164:0/3113909259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a381550f0 msgr2=0x7f3a38112840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.768 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3d6bf700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a381550f0 0x7f3a38112840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.768 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3d6bf700 1 -- 172.21.15.164:0/3113909259 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a380c4360 msgr2=0x7f3a38112350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.768 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3d6bf700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a380c4360 0x7f3a38112350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.768 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3d6bf700 1 -- 172.21.15.164:0/3113909259 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a38156770 con 0x7f3a380bff10 2020-11-20T11:50:39.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3cebe700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a380c4360 0x7f3a38112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:39.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3dec0700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a381550f0 0x7f3a38112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:39.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3d6bf700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a380bff10 0x7f3a3814bff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3a3400cb50 tx=0x7f3a34008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:39.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a257fa700 1 -- 172.21.15.164:0/3113909259 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340077d0 con 0x7f3a380bff10 2020-11-20T11:50:39.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a257fa700 1 -- 172.21.15.164:0/3113909259 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a34007930 con 0x7f3a380bff10 2020-11-20T11:50:39.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3f923700 1 -- 172.21.15.164:0/3113909259 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a38157760 con 0x7f3a380bff10 2020-11-20T11:50:39.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a257fa700 1 -- 172.21.15.164:0/3113909259 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34007cb0 con 0x7f3a380bff10 2020-11-20T11:50:39.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.755+0000 7f3a3f923700 1 -- 172.21.15.164:0/3113909259 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3814c4e0 con 0x7f3a380bff10 2020-11-20T11:50:39.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.756+0000 7f3a3f923700 1 -- 172.21.15.164:0/3113909259 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a381578f0 con 0x7f3a380bff10 2020-11-20T11:50:39.771 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.757+0000 7f3a257fa700 1 -- 172.21.15.164:0/3113909259 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3a34011620 con 0x7f3a380bff10 2020-11-20T11:50:39.771 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.757+0000 7f3a257fa700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a10080670 0x7f3a10082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:39.771 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.757+0000 7f3a3cebe700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a10080670 0x7f3a10082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:39.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.757+0000 7f3a257fa700 1 -- 172.21.15.164:0/3113909259 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3a340a2d10 con 0x7f3a380bff10 2020-11-20T11:50:39.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.758+0000 7f3a3cebe700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a10080670 0x7f3a10082b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3a3814d8a0 tx=0x7f3a28016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:39.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.761+0000 7f3a257fa700 1 -- 172.21.15.164:0/3113909259 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3a34077720 con 0x7f3a380bff10 2020-11-20T11:50:39.905 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.902+0000 7f3a3f923700 1 -- 172.21.15.164:0/3113909259 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a38069b70 con 0x7f3a380bff10 2020-11-20T11:50:39.909 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.903+0000 7f3a257fa700 1 -- 172.21.15.164:0/3113909259 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f3a3400a210 con 0x7f3a380bff10 2020-11-20T11:50:39.910 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 -- 172.21.15.164:0/3113909259 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a10080670 msgr2=0x7f3a10082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.911 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a10080670 0x7f3a10082b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3a3814d8a0 tx=0x7f3a28016000).stop 2020-11-20T11:50:39.911 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 -- 172.21.15.164:0/3113909259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a380bff10 msgr2=0x7f3a3814bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:39.911 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a380bff10 0x7f3a3814bff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3a3400cb50 tx=0x7f3a34008040).stop 2020-11-20T11:50:39.912 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 -- 172.21.15.164:0/3113909259 shutdown_connections 2020-11-20T11:50:39.912 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a10080670 0x7f3a10082b30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.912 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a380bff10 0x7f3a3814bff0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.913 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a381550f0 0x7f3a38112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.913 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 --2- 172.21.15.164:0/3113909259 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a380c4360 0x7f3a38112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:39.914 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 -- 172.21.15.164:0/3113909259 >> 172.21.15.164:0/3113909259 conn(0x7f3a380619e0 msgr2=0x7f3a380c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:39.914 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 -- 172.21.15.164:0/3113909259 shutdown_connections 2020-11-20T11:50:39.915 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:39.904+0000 7f3a3f923700 1 -- 172.21.15.164:0/3113909259 wait complete. 2020-11-20T11:50:39.915 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:39.916 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:39.612589+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:50:34.615204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:50:37.302647+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:39.919 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:40.029 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.026+0000 7fd87f9e1700 1 Processor -- start 2020-11-20T11:50:40.029 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.026+0000 7fd87f9e1700 1 -- start start 2020-11-20T11:50:40.035 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.027+0000 7fd87f9e1700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd8780c4740 0x7fd8781550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.035 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.027+0000 7fd87f9e1700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8781555e0 con 0x7fd8780c4360 2020-11-20T11:50:40.036 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.027+0000 7fd87f9e1700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd878151220 con 0x7fd878150520 2020-11-20T11:50:40.036 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.027+0000 7fd87f9e1700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8780bd090 con 0x7fd8780c4740 2020-11-20T11:50:40.036 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.027+0000 7fd87d77d700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fd8780c4360 0x7fd8780bfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55020/0 (socket says 172.21.15.164:55020) 2020-11-20T11:50:40.036 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.027+0000 7fd87d77d700 1 -- 172.21.15.164:0/3632119769 learned_addr learned my addr 172.21.15.164:0/3632119769 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:40.037 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.027+0000 7fd87cf7c700 1 --2- 172.21.15.164:0/3632119769 >> v2:172.21.15.188:3300/0 conn(0x7fd8780c4740 0x7fd8781550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.037 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099192138 0 0) 0x7fd8781555e0 con 0x7fd8780c4360 2020-11-20T11:50:40.037 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd860003280 con 0x7fd8780c4360 2020-11-20T11:50:40.037 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1783516473 0 0) 0x7fd860003280 con 0x7fd8780c4360 2020-11-20T11:50:40.038 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 >> v2:172.21.15.188:3300/0 conn(0x7fd8780c4740 msgr2=0x7fd8781550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:40.038 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 --2- 172.21.15.164:0/3632119769 >> v2:172.21.15.188:3300/0 conn(0x7fd8780c4740 0x7fd8781550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.038 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 >> v1:172.21.15.188:6789/0 conn(0x7fd878150520 legacy=0x7fd878150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.038 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8781514c0 con 0x7fd8780c4360 2020-11-20T11:50:40.038 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fd874001520 con 0x7fd8780c4360 2020-11-20T11:50:40.039 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 >> v1:172.21.15.164:6789/0 conn(0x7fd8780c4360 legacy=0x7fd8780bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.039 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8600037c0 0x7fd860003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.039 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd860004520 0x7fd8600049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.039 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd860004e90 0x7fd86000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.039 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780bd090 con 0x7fd860004e90 2020-11-20T11:50:40.040 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd860005340 con 0x7fd8600037c0 2020-11-20T11:50:40.040 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86000bc60 con 0x7fd860004520 2020-11-20T11:50:40.040 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd87d77d700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8600037c0 0x7fd860003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.040 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd87cf7c700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd860004520 0x7fd8600049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.041 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd87d77d700 1 -- 172.21.15.164:0/3632119769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd860004520 msgr2=0x7fd8600049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:40.041 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd87d77d700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd860004520 0x7fd8600049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.041 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd87d77d700 1 -- 172.21.15.164:0/3632119769 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd860004e90 msgr2=0x7fd86000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:40.041 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd87d77d700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd860004e90 0x7fd86000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:40.041 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd87d77d700 1 -- 172.21.15.164:0/3632119769 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860003280 con 0x7fd8600037c0 2020-11-20T11:50:40.042 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd87df7e700 1 -- 172.21.15.164:0/3632119769 reap_dead start 2020-11-20T11:50:40.042 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd87cf7c700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd860004520 0x7fd8600049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:40.043 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd87d77d700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8600037c0 0x7fd860003be0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd87400c440 tx=0x7fd8781513b0).ready entity=mon.1 client_cookie=6781b157c93ebc35 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:40.043 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740072e0 con 0x7fd8600037c0 2020-11-20T11:50:40.043 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd874007440 con 0x7fd8600037c0 2020-11-20T11:50:40.043 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.028+0000 7fd867fff700 1 -- 172.21.15.164:0/3632119769 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874005860 con 0x7fd8600037c0 2020-11-20T11:50:40.044 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.029+0000 7fd87f9e1700 1 -- 172.21.15.164:0/3632119769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8600037c0 msgr2=0x7fd860003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.044 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.029+0000 7fd87f9e1700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8600037c0 0x7fd860003be0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd87400c440 tx=0x7fd8781513b0).stop 2020-11-20T11:50:40.044 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.029+0000 7fd87f9e1700 1 -- 172.21.15.164:0/3632119769 shutdown_connections 2020-11-20T11:50:40.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.029+0000 7fd87f9e1700 1 --2- 172.21.15.164:0/3632119769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8600037c0 0x7fd860003be0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.029+0000 7fd87f9e1700 1 -- 172.21.15.164:0/3632119769 >> 172.21.15.164:0/3632119769 conn(0x7fd8780619e0 msgr2=0x7fd878061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:40.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.029+0000 7fd87f9e1700 1 -- 172.21.15.164:0/3632119769 shutdown_connections 2020-11-20T11:50:40.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.029+0000 7fd87f9e1700 1 -- 172.21.15.164:0/3632119769 wait complete. 2020-11-20T11:50:40.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.030+0000 7fd87f9e1700 1 Processor -- start 2020-11-20T11:50:40.046 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.030+0000 7fd87f9e1700 1 -- start start 2020-11-20T11:50:40.046 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87f9e1700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8600037c0 0x7fd878112150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.047 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87f9e1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd878112640 0x7fd878113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.047 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87f9e1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd878153500 0x7fd878114160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.047 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87f9e1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd878160750 con 0x7fd878112640 2020-11-20T11:50:40.047 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87f9e1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8781609f0 con 0x7fd878153500 2020-11-20T11:50:40.047 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87f9e1700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd878160c90 con 0x7fd8600037c0 2020-11-20T11:50:40.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87df7e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd878153500 0x7fd878114160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87df7e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd878153500 0x7fd878114160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45296/0 (socket says 172.21.15.164:45296) 2020-11-20T11:50:40.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87df7e700 1 -- 172.21.15.164:0/4283233691 learned_addr learned my addr 172.21.15.164:0/4283233691 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:40.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87d77d700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8600037c0 0x7fd878112150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87cf7c700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd878112640 0x7fd878113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87df7e700 1 -- 172.21.15.164:0/4283233691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8600037c0 msgr2=0x7fd878112150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87df7e700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8600037c0 0x7fd878112150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87df7e700 1 -- 172.21.15.164:0/4283233691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd878112640 msgr2=0x7fd878113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87df7e700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd878112640 0x7fd878113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87df7e700 1 -- 172.21.15.164:0/4283233691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878160f30 con 0x7fd878153500 2020-11-20T11:50:40.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87cf7c700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd878112640 0x7fd878113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:40.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.031+0000 7fd87df7e700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd878153500 0x7fd878114160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd878082000 tx=0x7fd870007d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:40.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.032+0000 7fd8657fa700 1 -- 172.21.15.164:0/4283233691 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870005ab0 con 0x7fd878153500 2020-11-20T11:50:40.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.032+0000 7fd8657fa700 1 -- 172.21.15.164:0/4283233691 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd870005c10 con 0x7fd878153500 2020-11-20T11:50:40.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.032+0000 7fd87f9e1700 1 -- 172.21.15.164:0/4283233691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8781611d0 con 0x7fd878153500 2020-11-20T11:50:40.051 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.032+0000 7fd8657fa700 1 -- 172.21.15.164:0/4283233691 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870007030 con 0x7fd878153500 2020-11-20T11:50:40.051 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.032+0000 7fd87f9e1700 1 -- 172.21.15.164:0/4283233691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8780c7730 con 0x7fd878153500 2020-11-20T11:50:40.051 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.032+0000 7fd87f9e1700 1 -- 172.21.15.164:0/4283233691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd878069b70 con 0x7fd878153500 2020-11-20T11:50:40.052 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.033+0000 7fd8657fa700 1 -- 172.21.15.164:0/4283233691 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd87001b060 con 0x7fd878153500 2020-11-20T11:50:40.052 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.033+0000 7fd8657fa700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd850080670 0x7fd850082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.034+0000 7fd8657fa700 1 -- 172.21.15.164:0/4283233691 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd8700a2280 con 0x7fd878153500 2020-11-20T11:50:40.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.034+0000 7fd87d77d700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd850080670 0x7fd850082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.034+0000 7fd87d77d700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd850080670 0x7fd850082b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd874007940 tx=0x7fd874013000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:40.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.037+0000 7fd8657fa700 1 -- 172.21.15.164:0/4283233691 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd870076c90 con 0x7fd878153500 2020-11-20T11:50:40.186 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.180+0000 7fd87f9e1700 1 -- 172.21.15.164:0/4283233691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd878061230 con 0x7fd878153500 2020-11-20T11:50:40.186 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.181+0000 7fd8657fa700 1 -- 172.21.15.164:0/4283233691 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7fd870019020 con 0x7fd878153500 2020-11-20T11:50:40.186 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.182+0000 7fd87f9e1700 1 -- 172.21.15.164:0/4283233691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd850080670 msgr2=0x7fd850082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.187 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.182+0000 7fd87f9e1700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd850080670 0x7fd850082b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd874007940 tx=0x7fd874013000).stop 2020-11-20T11:50:40.187 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.182+0000 7fd87f9e1700 1 -- 172.21.15.164:0/4283233691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd878153500 msgr2=0x7fd878114160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.187 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.182+0000 7fd87f9e1700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd878153500 0x7fd878114160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd878082000 tx=0x7fd870007d40).stop 2020-11-20T11:50:40.187 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.183+0000 7fd87f9e1700 1 -- 172.21.15.164:0/4283233691 shutdown_connections 2020-11-20T11:50:40.187 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.183+0000 7fd87f9e1700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd850080670 0x7fd850082b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.188 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.183+0000 7fd87f9e1700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd878153500 0x7fd878114160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.188 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.183+0000 7fd87f9e1700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8600037c0 0x7fd878112150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.188 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.183+0000 7fd87f9e1700 1 --2- 172.21.15.164:0/4283233691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd878112640 0x7fd878113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.188 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.183+0000 7fd87f9e1700 1 -- 172.21.15.164:0/4283233691 >> 172.21.15.164:0/4283233691 conn(0x7fd8780619e0 msgr2=0x7fd8780be440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:40.188 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.183+0000 7fd87f9e1700 1 -- 172.21.15.164:0/4283233691 shutdown_connections 2020-11-20T11:50:40.189 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.183+0000 7fd87f9e1700 1 -- 172.21.15.164:0/4283233691 wait complete. 2020-11-20T11:50:40.189 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:40.189 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:39.612589+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:50:34.615204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:50:37.302647+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:40.199 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2020-11-20T11:50:40.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.308+0000 7f1d9dd2c700 1 Processor -- start 2020-11-20T11:50:40.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.308+0000 7f1d9dd2c700 1 -- start start 2020-11-20T11:50:40.313 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d9dd2c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1d980bccf0 0x7f1d980c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.313 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d9dd2c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1d980c0ba0 0x7f1d980bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d9dd2c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d98151780 con 0x7f1d980c4200 2020-11-20T11:50:40.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d9dd2c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d98151a20 con 0x7f1d980c0ba0 2020-11-20T11:50:40.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d9dd2c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d98151cc0 con 0x7f1d980bccf0 2020-11-20T11:50:40.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d96ffd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1d980bccf0 0x7f1d980c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.315 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d96ffd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1d980bccf0 0x7f1d980c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45300/0 (socket says 172.21.15.164:45300) 2020-11-20T11:50:40.315 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d96ffd700 1 -- 172.21.15.164:0/1207557443 learned_addr learned my addr 172.21.15.164:0/1207557443 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:40.315 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d97fff700 1 --2- 172.21.15.164:0/1207557443 >> v2:172.21.15.36:3300/0 conn(0x7f1d980c0ba0 0x7f1d980bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.315 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d96ffd700 1 -- 172.21.15.164:0/1207557443 >> v2:172.21.15.36:3300/0 conn(0x7f1d980c0ba0 msgr2=0x7f1d980bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:40.315 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d96ffd700 1 --2- 172.21.15.164:0/1207557443 >> v2:172.21.15.36:3300/0 conn(0x7f1d980c0ba0 0x7f1d980bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.316 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d96ffd700 1 -- 172.21.15.164:0/1207557443 >> v1:172.21.15.36:6789/0 conn(0x7f1d980c4200 legacy=0x7f1d98150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:40.316 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d96ffd700 1 -- 172.21.15.164:0/1207557443 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d980c0460 con 0x7f1d980bccf0 2020-11-20T11:50:40.316 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.309+0000 7f1d97fff700 1 --2- 172.21.15.164:0/1207557443 >> v2:172.21.15.36:3300/0 conn(0x7f1d980c0ba0 0x7f1d980bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:40.316 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d96ffd700 1 --2- 172.21.15.164:0/1207557443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980bccf0 0x7f1d980c45e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f1d980c4ef0 tx=0x7f1d8c006ef0).ready entity=mon.1 client_cookie=5b90fa922822ca5f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:40.316 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d967fc700 1 -- 172.21.15.164:0/1207557443 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00b820 con 0x7f1d980bccf0 2020-11-20T11:50:40.317 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d967fc700 1 -- 172.21.15.164:0/1207557443 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c000e90 con 0x7f1d980bccf0 2020-11-20T11:50:40.317 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d967fc700 1 -- 172.21.15.164:0/1207557443 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00bb90 con 0x7f1d980bccf0 2020-11-20T11:50:40.317 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/1207557443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980bccf0 msgr2=0x7f1d980c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.317 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d9dd2c700 1 --2- 172.21.15.164:0/1207557443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980bccf0 0x7f1d980c45e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f1d980c4ef0 tx=0x7f1d8c006ef0).stop 2020-11-20T11:50:40.317 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/1207557443 shutdown_connections 2020-11-20T11:50:40.318 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d9dd2c700 1 --2- 172.21.15.164:0/1207557443 >> v2:172.21.15.36:3300/0 conn(0x7f1d980c0ba0 0x7f1d980bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.318 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d9dd2c700 1 --2- 172.21.15.164:0/1207557443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980bccf0 0x7f1d980c45e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.318 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/1207557443 >> 172.21.15.164:0/1207557443 conn(0x7f1d980678e0 msgr2=0x7f1d98067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:40.318 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/1207557443 shutdown_connections 2020-11-20T11:50:40.318 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.310+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/1207557443 wait complete. 2020-11-20T11:50:40.321 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d9dd2c700 1 Processor -- start 2020-11-20T11:50:40.321 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d9dd2c700 1 -- start start 2020-11-20T11:50:40.321 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d9dd2c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d980bccf0 0x7f1d98149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.322 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d9dd2c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980c0ba0 0x7f1d9814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.322 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d9dd2c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d980c4200 0x7f1d98150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.323 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d9dd2c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98163ef0 con 0x7f1d980c4200 2020-11-20T11:50:40.323 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d9dd2c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98164190 con 0x7f1d980c0ba0 2020-11-20T11:50:40.323 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d9dd2c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98164430 con 0x7f1d980bccf0 2020-11-20T11:50:40.324 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d96ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980c0ba0 0x7f1d9814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.324 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d96ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980c0ba0 0x7f1d9814fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45308/0 (socket says 172.21.15.164:45308) 2020-11-20T11:50:40.325 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.312+0000 7f1d96ffd700 1 -- 172.21.15.164:0/496009139 learned_addr learned my addr 172.21.15.164:0/496009139 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:40.325 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d977fe700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d980bccf0 0x7f1d98149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.325 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d97fff700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d980c4200 0x7f1d98150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.326 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d96ffd700 1 -- 172.21.15.164:0/496009139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d980bccf0 msgr2=0x7f1d98149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.326 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d96ffd700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d980bccf0 0x7f1d98149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.327 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d96ffd700 1 -- 172.21.15.164:0/496009139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d980c4200 msgr2=0x7f1d98150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.327 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d96ffd700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d980c4200 0x7f1d98150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.327 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d96ffd700 1 -- 172.21.15.164:0/496009139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d981646d0 con 0x7f1d980c0ba0 2020-11-20T11:50:40.328 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d96ffd700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980c0ba0 0x7f1d9814fc50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f1d8c006f30 tx=0x7f1d8c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:40.328 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d777fe700 1 -- 172.21.15.164:0/496009139 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c011ce0 con 0x7f1d980c0ba0 2020-11-20T11:50:40.328 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d777fe700 1 -- 172.21.15.164:0/496009139 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c011e60 con 0x7f1d980c0ba0 2020-11-20T11:50:40.329 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/496009139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d98164970 con 0x7f1d980c0ba0 2020-11-20T11:50:40.329 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d777fe700 1 -- 172.21.15.164:0/496009139 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c01d6d0 con 0x7f1d980c0ba0 2020-11-20T11:50:40.330 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.313+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/496009139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9814e720 con 0x7f1d980c0ba0 2020-11-20T11:50:40.330 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.314+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/496009139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9814e910 con 0x7f1d980c0ba0 2020-11-20T11:50:40.330 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.315+0000 7f1d777fe700 1 -- 172.21.15.164:0/496009139 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1d8c017070 con 0x7f1d980c0ba0 2020-11-20T11:50:40.331 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.315+0000 7f1d777fe700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1d70080670 0x7f1d70082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.331 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.315+0000 7f1d777fe700 1 -- 172.21.15.164:0/496009139 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1d8c0a4850 con 0x7f1d980c0ba0 2020-11-20T11:50:40.332 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.315+0000 7f1d977fe700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1d70080670 0x7f1d70082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.332 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.315+0000 7f1d977fe700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1d70080670 0x7f1d70082b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1d8800c8c0 tx=0x7f1d88008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:40.332 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.318+0000 7f1d777fe700 1 -- 172.21.15.164:0/496009139 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1d8c079260 con 0x7f1d980c0ba0 2020-11-20T11:50:40.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.507+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/496009139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1d9814da30 con 0x7f1d980c0ba0 2020-11-20T11:50:40.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.623+0000 7f1d777fe700 1 -- 172.21.15.164:0/496009139 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1d8c015030 con 0x7f1d980c0ba0 2020-11-20T11:50:40.628 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/496009139 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1d70080670 msgr2=0x7f1d70082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.628 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1d70080670 0x7f1d70082b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1d8800c8c0 tx=0x7f1d88008040).stop 2020-11-20T11:50:40.628 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/496009139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980c0ba0 msgr2=0x7f1d9814fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.628 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980c0ba0 0x7f1d9814fc50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f1d8c006f30 tx=0x7f1d8c016000).stop 2020-11-20T11:50:40.628 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/496009139 shutdown_connections 2020-11-20T11:50:40.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1d70080670 0x7f1d70082b30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d980c4200 0x7f1d98150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d980bccf0 0x7f1d98149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 --2- 172.21.15.164:0/496009139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d980c0ba0 0x7f1d9814fc50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/496009139 >> 172.21.15.164:0/496009139 conn(0x7f1d980678e0 msgr2=0x7f1d9814ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:40.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/496009139 shutdown_connections 2020-11-20T11:50:40.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.625+0000 7f1d9dd2c700 1 -- 172.21.15.164:0/496009139 wait complete. 2020-11-20T11:50:40.639 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2020-11-20T11:50:40.762 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.759+0000 7fc14d73d700 1 Processor -- start 2020-11-20T11:50:40.762 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.759+0000 7fc14d73d700 1 -- start start 2020-11-20T11:50:40.764 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.760+0000 7fc14d73d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1480c4200 0x7fc1480bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.765 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.760+0000 7fc14d73d700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc1480c0ba0 0x7fc1480bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.765 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.760+0000 7fc14d73d700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc148151780 con 0x7fc1480c45e0 2020-11-20T11:50:40.765 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.760+0000 7fc14d73d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1480c4a60 con 0x7fc1480c4200 2020-11-20T11:50:40.765 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.760+0000 7fc14d73d700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc148151a20 con 0x7fc1480c0ba0 2020-11-20T11:50:40.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.760+0000 7fc1477fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc1480c0ba0 0x7fc1480bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc1477fe700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc1480c0ba0 0x7fc1480bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.164:38578/0 (socket says 172.21.15.164:38578) 2020-11-20T11:50:40.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc1477fe700 1 -- 172.21.15.164:0/3535327903 learned_addr learned my addr 172.21.15.164:0/3535327903 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:40.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc1467fc700 1 --1- 172.21.15.164:0/3535327903 >> v1:172.21.15.188:6789/0 conn(0x7fc1480c45e0 0x7fc148150fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.164:40370/0 (socket says 172.21.15.164:40370) 2020-11-20T11:50:40.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc146ffd700 1 --2- 172.21.15.164:0/3535327903 >> v2:172.21.15.36:3300/0 conn(0x7fc1480c4200 0x7fc1480bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc1477fe700 1 -- 172.21.15.164:0/3535327903 >> v2:172.21.15.36:3300/0 conn(0x7fc1480c4200 msgr2=0x7fc1480bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:40.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc1477fe700 1 --2- 172.21.15.164:0/3535327903 >> v2:172.21.15.36:3300/0 conn(0x7fc1480c4200 0x7fc1480bccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc1477fe700 1 -- 172.21.15.164:0/3535327903 >> v1:172.21.15.188:6789/0 conn(0x7fc1480c45e0 legacy=0x7fc148150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc1477fe700 1 -- 172.21.15.164:0/3535327903 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc148151cc0 con 0x7fc1480c0ba0 2020-11-20T11:50:40.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc1477fe700 1 --2- 172.21.15.164:0/3535327903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1480c0ba0 0x7fc1480bf550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc148061610 tx=0x7fc1400092d0).ready entity=mon.2 client_cookie=467b93049bf51bb2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:40.768 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc145ffb700 1 -- 172.21.15.164:0/3535327903 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14000bbf0 con 0x7fc1480c0ba0 2020-11-20T11:50:40.768 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc145ffb700 1 -- 172.21.15.164:0/3535327903 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14000bd50 con 0x7fc1480c0ba0 2020-11-20T11:50:40.768 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc145ffb700 1 -- 172.21.15.164:0/3535327903 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140011610 con 0x7fc1480c0ba0 2020-11-20T11:50:40.768 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc14d73d700 1 -- 172.21.15.164:0/3535327903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1480c0ba0 msgr2=0x7fc1480bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.768 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.761+0000 7fc14d73d700 1 --2- 172.21.15.164:0/3535327903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1480c0ba0 0x7fc1480bf550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc148061610 tx=0x7fc1400092d0).stop 2020-11-20T11:50:40.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.762+0000 7fc14d73d700 1 -- 172.21.15.164:0/3535327903 shutdown_connections 2020-11-20T11:50:40.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.762+0000 7fc14d73d700 1 --2- 172.21.15.164:0/3535327903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1480c0ba0 0x7fc1480bf550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.762+0000 7fc14d73d700 1 --2- 172.21.15.164:0/3535327903 >> v2:172.21.15.36:3300/0 conn(0x7fc1480c4200 0x7fc1480bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.762+0000 7fc14d73d700 1 -- 172.21.15.164:0/3535327903 >> 172.21.15.164:0/3535327903 conn(0x7fc1480678e0 msgr2=0x7fc148067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:40.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.762+0000 7fc14d73d700 1 -- 172.21.15.164:0/3535327903 shutdown_connections 2020-11-20T11:50:40.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.762+0000 7fc14d73d700 1 -- 172.21.15.164:0/3535327903 wait complete. 2020-11-20T11:50:40.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.763+0000 7fc14d73d700 1 Processor -- start 2020-11-20T11:50:40.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.763+0000 7fc14d73d700 1 -- start start 2020-11-20T11:50:40.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.763+0000 7fc14d73d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1480c0ba0 0x7fc148164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.763+0000 7fc14d73d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1480c4200 0x7fc148160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.763+0000 7fc14d73d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1480c45e0 0x7fc14814c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.763+0000 7fc14d73d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc148163660 con 0x7fc1480c4200 2020-11-20T11:50:40.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.763+0000 7fc14d73d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc148161020 con 0x7fc1480c0ba0 2020-11-20T11:50:40.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.763+0000 7fc14d73d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14814f820 con 0x7fc1480c45e0 2020-11-20T11:50:40.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc146ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1480c0ba0 0x7fc148164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc146ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1480c0ba0 0x7fc148164230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45320/0 (socket says 172.21.15.164:45320) 2020-11-20T11:50:40.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc146ffd700 1 -- 172.21.15.164:0/4079676989 learned_addr learned my addr 172.21.15.164:0/4079676989 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:40.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc1467fc700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1480c4200 0x7fc148160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc1477fe700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1480c45e0 0x7fc14814c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc146ffd700 1 -- 172.21.15.164:0/4079676989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1480c45e0 msgr2=0x7fc14814c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc146ffd700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1480c45e0 0x7fc14814c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc146ffd700 1 -- 172.21.15.164:0/4079676989 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1480c4200 msgr2=0x7fc148160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:40.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc146ffd700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1480c4200 0x7fc148160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:40.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc146ffd700 1 -- 172.21.15.164:0/4079676989 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14814fac0 con 0x7fc1480c0ba0 2020-11-20T11:50:40.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc1477fe700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1480c45e0 0x7fc14814c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:40.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc146ffd700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1480c0ba0 0x7fc148164230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc13800eba0 tx=0x7fc138006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:40.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc12effd700 1 -- 172.21.15.164:0/4079676989 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13800c920 con 0x7fc1480c0ba0 2020-11-20T11:50:40.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc12effd700 1 -- 172.21.15.164:0/4079676989 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13800ca80 con 0x7fc1480c0ba0 2020-11-20T11:50:40.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc12effd700 1 -- 172.21.15.164:0/4079676989 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13800ce00 con 0x7fc1480c0ba0 2020-11-20T11:50:40.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc14d73d700 1 -- 172.21.15.164:0/4079676989 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc148163850 con 0x7fc1480c0ba0 2020-11-20T11:50:40.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.764+0000 7fc14d73d700 1 -- 172.21.15.164:0/4079676989 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc148163d90 con 0x7fc1480c0ba0 2020-11-20T11:50:40.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.765+0000 7fc14d73d700 1 -- 172.21.15.164:0/4079676989 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc148069b70 con 0x7fc1480c0ba0 2020-11-20T11:50:40.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.766+0000 7fc12effd700 1 -- 172.21.15.164:0/4079676989 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc138012600 con 0x7fc1480c0ba0 2020-11-20T11:50:40.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.766+0000 7fc12effd700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1240806a0 0x7fc124082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:40.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.766+0000 7fc12effd700 1 -- 172.21.15.164:0/4079676989 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc1380a2da0 con 0x7fc1480c0ba0 2020-11-20T11:50:40.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.766+0000 7fc1467fc700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1240806a0 0x7fc124082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:40.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.766+0000 7fc1467fc700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1240806a0 0x7fc124082b60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc14814d330 tx=0x7fc13c000bc0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:40.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.770+0000 7fc12effd700 1 -- 172.21.15.164:0/4079676989 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc1380777b0 con 0x7fc1480c0ba0 2020-11-20T11:50:40.959 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:40.957+0000 7fc14d73d700 1 -- 172.21.15.164:0/4079676989 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fc14805d590 con 0x7fc1480c0ba0 2020-11-20T11:50:41.627 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.624+0000 7fc12effd700 1 -- 172.21.15.164:0/4079676989 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v7) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc13807add0 con 0x7fc1480c0ba0 2020-11-20T11:50:41.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 -- 172.21.15.164:0/4079676989 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1240806a0 msgr2=0x7fc124082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:41.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1240806a0 0x7fc124082b60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc14814d330 tx=0x7fc13c000bc0).stop 2020-11-20T11:50:41.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 -- 172.21.15.164:0/4079676989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1480c0ba0 msgr2=0x7fc148164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:41.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1480c0ba0 0x7fc148164230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc13800eba0 tx=0x7fc138006e30).stop 2020-11-20T11:50:41.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 -- 172.21.15.164:0/4079676989 shutdown_connections 2020-11-20T11:50:41.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1240806a0 0x7fc124082b60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1480c0ba0 0x7fc148164230 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1480c45e0 0x7fc14814c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 --2- 172.21.15.164:0/4079676989 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1480c4200 0x7fc148160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 -- 172.21.15.164:0/4079676989 >> 172.21.15.164:0/4079676989 conn(0x7fc1480678e0 msgr2=0x7fc14814ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:41.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 -- 172.21.15.164:0/4079676989 shutdown_connections 2020-11-20T11:50:41.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.626+0000 7fc14d73d700 1 -- 172.21.15.164:0/4079676989 wait complete. 2020-11-20T11:50:41.643 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:50:41.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.767+0000 7f471ac33700 1 Processor -- start 2020-11-20T11:50:41.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.767+0000 7f471ac33700 1 -- start start 2020-11-20T11:50:41.771 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.767+0000 7f471ac33700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f47140c4360 0x7f47140c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:41.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.767+0000 7f471ac33700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4714150520 0x7f4714150950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:41.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.767+0000 7f471ac33700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4714151220 con 0x7f47141550f0 2020-11-20T11:50:41.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.767+0000 7f471ac33700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47140bd090 con 0x7f47140c4360 2020-11-20T11:50:41.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.767+0000 7f471ac33700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47141514c0 con 0x7f4714150520 2020-11-20T11:50:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47191d0700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4714150520 0x7f4714150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47191d0700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4714150520 0x7f4714150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45328/0 (socket says 172.21.15.164:45328) 2020-11-20T11:50:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47191d0700 1 -- 172.21.15.164:0/3194498227 learned_addr learned my addr 172.21.15.164:0/3194498227 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47189cf700 1 --2- 172.21.15.164:0/3194498227 >> v2:172.21.15.36:3300/0 conn(0x7f47140c4360 0x7f47140c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47191d0700 1 -- 172.21.15.164:0/3194498227 >> v2:172.21.15.36:3300/0 conn(0x7f47140c4360 msgr2=0x7f47140c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47191d0700 1 --2- 172.21.15.164:0/3194498227 >> v2:172.21.15.36:3300/0 conn(0x7f47140c4360 0x7f47140c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47191d0700 1 -- 172.21.15.164:0/3194498227 >> v1:172.21.15.36:6789/0 conn(0x7f47141550f0 legacy=0x7f47140bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47191d0700 1 -- 172.21.15.164:0/3194498227 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714151760 con 0x7f4714150520 2020-11-20T11:50:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47189cf700 1 --2- 172.21.15.164:0/3194498227 >> v2:172.21.15.36:3300/0 conn(0x7f47140c4360 0x7f47140c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47191d0700 1 --2- 172.21.15.164:0/3194498227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 0x7f4714150950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f47140bd360 tx=0x7f470c0092d0).ready entity=mon.1 client_cookie=ff67d67c76c98d9b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:41.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47137fe700 1 -- 172.21.15.164:0/3194498227 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c00bbf0 con 0x7f4714150520 2020-11-20T11:50:41.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47137fe700 1 -- 172.21.15.164:0/3194498227 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c00bd50 con 0x7f4714150520 2020-11-20T11:50:41.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.768+0000 7f47137fe700 1 -- 172.21.15.164:0/3194498227 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c011610 con 0x7f4714150520 2020-11-20T11:50:41.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.769+0000 7f471ac33700 1 -- 172.21.15.164:0/3194498227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 msgr2=0x7f4714150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:41.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.769+0000 7f471ac33700 1 --2- 172.21.15.164:0/3194498227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 0x7f4714150950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f47140bd360 tx=0x7f470c0092d0).stop 2020-11-20T11:50:41.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.769+0000 7f471ac33700 1 -- 172.21.15.164:0/3194498227 shutdown_connections 2020-11-20T11:50:41.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.769+0000 7f471ac33700 1 --2- 172.21.15.164:0/3194498227 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 0x7f4714150950 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.769+0000 7f471ac33700 1 --2- 172.21.15.164:0/3194498227 >> v2:172.21.15.36:3300/0 conn(0x7f47140c4360 0x7f47140c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.769+0000 7f471ac33700 1 -- 172.21.15.164:0/3194498227 >> 172.21.15.164:0/3194498227 conn(0x7f47140619e0 msgr2=0x7f4714061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:41.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.769+0000 7f471ac33700 1 -- 172.21.15.164:0/3194498227 shutdown_connections 2020-11-20T11:50:41.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.769+0000 7f471ac33700 1 -- 172.21.15.164:0/3194498227 wait complete. 2020-11-20T11:50:41.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.770+0000 7f471ac33700 1 Processor -- start 2020-11-20T11:50:41.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.770+0000 7f471ac33700 1 -- start start 2020-11-20T11:50:41.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f471ac33700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47140c4360 0x7f47141565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:41.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f471ac33700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 0x7f4714157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:41.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f471ac33700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47141550f0 0x7f4714160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:41.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f471ac33700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714157e00 con 0x7f47141550f0 2020-11-20T11:50:41.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f471ac33700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47141580a0 con 0x7f4714150520 2020-11-20T11:50:41.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f471ac33700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714155bd0 con 0x7f47140c4360 2020-11-20T11:50:41.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4713fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 0x7f4714157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:41.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4713fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 0x7f4714157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45336/0 (socket says 172.21.15.164:45336) 2020-11-20T11:50:41.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4713fff700 1 -- 172.21.15.164:0/1615205880 learned_addr learned my addr 172.21.15.164:0/1615205880 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:41.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f47191d0700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47141550f0 0x7f4714160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:41.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f47189cf700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47140c4360 0x7f47141565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:41.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4713fff700 1 -- 172.21.15.164:0/1615205880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47140c4360 msgr2=0x7f47141565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:41.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4713fff700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47140c4360 0x7f47141565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4713fff700 1 -- 172.21.15.164:0/1615205880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47141550f0 msgr2=0x7f4714160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:41.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4713fff700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47141550f0 0x7f4714160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4713fff700 1 -- 172.21.15.164:0/1615205880 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714155e70 con 0x7f4714150520 2020-11-20T11:50:41.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f47189cf700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47140c4360 0x7f47141565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:41.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4713fff700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 0x7f4714157490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4700001eb0 tx=0x7f4700007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:41.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4710ff9700 1 -- 172.21.15.164:0/1615205880 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470000e4a0 con 0x7f4714150520 2020-11-20T11:50:41.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4710ff9700 1 -- 172.21.15.164:0/1615205880 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470000e600 con 0x7f4714150520 2020-11-20T11:50:41.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f471ac33700 1 -- 172.21.15.164:0/1615205880 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4714156110 con 0x7f4714150520 2020-11-20T11:50:41.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f4710ff9700 1 -- 172.21.15.164:0/1615205880 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470000e9a0 con 0x7f4714150520 2020-11-20T11:50:41.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.771+0000 7f471ac33700 1 -- 172.21.15.164:0/1615205880 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4714157980 con 0x7f4714150520 2020-11-20T11:50:41.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.772+0000 7f471ac33700 1 -- 172.21.15.164:0/1615205880 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47141562a0 con 0x7f4714150520 2020-11-20T11:50:41.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.773+0000 7f4710ff9700 1 -- 172.21.15.164:0/1615205880 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4700019030 con 0x7f4714150520 2020-11-20T11:50:41.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.774+0000 7f4710ff9700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f46ec080670 0x7f46ec082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:41.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.774+0000 7f4710ff9700 1 -- 172.21.15.164:0/1615205880 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f47000a1e70 con 0x7f4714150520 2020-11-20T11:50:41.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.774+0000 7f47189cf700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f46ec080670 0x7f46ec082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:41.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.774+0000 7f47189cf700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f46ec080670 0x7f46ec082b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4708006c10 tx=0x7f4708008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:41.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.777+0000 7f4710ff9700 1 -- 172.21.15.164:0/1615205880 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4700076880 con 0x7f4714150520 2020-11-20T11:50:41.970 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.967+0000 7f471ac33700 1 -- 172.21.15.164:0/1615205880 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4714069b70 con 0x7f4714150520 2020-11-20T11:50:41.970 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.967+0000 7f4710ff9700 1 -- 172.21.15.164:0/1615205880 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2489 (secure 0 0 0) 0x7f4700017030 con 0x7f4714150520 2020-11-20T11:50:41.970 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:41.971 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1360026757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1360026757},{"type":"v1","addr":"172.21.15.164:6835","nonce":1360026757}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3921177334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3921177334},{"type":"v1","addr":"172.21.15.188:6833","nonce":3921177334}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:50:39.612795+0000","modified":"2020-11-20T11:50:41.621570+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6833/1888702035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":1888702035},{"type":"v1","addr":"172.21.15.36:6833","nonce":1888702035}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:50:41.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 -- 172.21.15.164:0/1615205880 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f46ec080670 msgr2=0x7f46ec082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:41.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f46ec080670 0x7f46ec082b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4708006c10 tx=0x7f4708008040).stop 2020-11-20T11:50:41.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 -- 172.21.15.164:0/1615205880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 msgr2=0x7f4714157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:41.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 0x7f4714157490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4700001eb0 tx=0x7f4700007c50).stop 2020-11-20T11:50:41.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 -- 172.21.15.164:0/1615205880 shutdown_connections 2020-11-20T11:50:41.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f46ec080670 0x7f46ec082b30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47141550f0 0x7f4714160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47140c4360 0x7f47141565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 --2- 172.21.15.164:0/1615205880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4714150520 0x7f4714157490 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:41.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 -- 172.21.15.164:0/1615205880 >> 172.21.15.164:0/1615205880 conn(0x7f47140619e0 msgr2=0x7f471414d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:41.974 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 -- 172.21.15.164:0/1615205880 shutdown_connections 2020-11-20T11:50:41.974 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:41.969+0000 7f471ac33700 1 -- 172.21.15.164:0/1615205880 wait complete. 2020-11-20T11:50:41.974 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 7 2020-11-20T11:50:41.984 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:42.095 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.092+0000 7fe56cc8d700 1 Processor -- start 2020-11-20T11:50:42.096 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.092+0000 7fe56cc8d700 1 -- start start 2020-11-20T11:50:42.108 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe56cc8d700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe5680bdfc0 0x7fe56809e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.108 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe56cc8d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5681512d0 con 0x7fe56809e560 2020-11-20T11:50:42.109 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe56cc8d700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe568151570 con 0x7fe5680bdbe0 2020-11-20T11:50:42.109 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe56cc8d700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe568151810 con 0x7fe5680bdfc0 2020-11-20T11:50:42.110 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe567fff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fe56809e560 0x7fe568150610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55086/0 (socket says 172.21.15.164:55086) 2020-11-20T11:50:42.110 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe567fff700 1 -- 172.21.15.164:0/769887877 learned_addr learned my addr 172.21.15.164:0/769887877 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:42.110 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe566ffd700 1 --2- 172.21.15.164:0/769887877 >> v2:172.21.15.188:3300/0 conn(0x7fe5680bdfc0 0x7fe56809e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.111 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062553644 0 0) 0x7fe5681512d0 con 0x7fe56809e560 2020-11-20T11:50:42.111 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe554003280 con 0x7fe56809e560 2020-11-20T11:50:42.112 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3439637148 0 0) 0x7fe554003280 con 0x7fe56809e560 2020-11-20T11:50:42.112 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 >> v2:172.21.15.188:3300/0 conn(0x7fe5680bdfc0 msgr2=0x7fe56809e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:42.112 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 --2- 172.21.15.164:0/769887877 >> v2:172.21.15.188:3300/0 conn(0x7fe5680bdfc0 0x7fe56809e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.113 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 >> v1:172.21.15.188:6789/0 conn(0x7fe5680bdbe0 legacy=0x7fe56809ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.114 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568151ab0 con 0x7fe56809e560 2020-11-20T11:50:42.114 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fe5600018a0 con 0x7fe56809e560 2020-11-20T11:50:42.115 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 >> v1:172.21.15.164:6789/0 conn(0x7fe56809e560 legacy=0x7fe568150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.115 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5540037c0 0x7fe554003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.116 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe554004520 0x7fe5540049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.116 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe554004e90 0x7fe55400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe568151810 con 0x7fe5540037c0 2020-11-20T11:50:42.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe554005370 con 0x7fe554004e90 2020-11-20T11:50:42.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.093+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55400bc60 con 0x7fe554004520 2020-11-20T11:50:42.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe567fff700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe554004e90 0x7fe55400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe566ffd700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe554004520 0x7fe5540049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe5677fe700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5540037c0 0x7fe554003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe567fff700 1 -- 172.21.15.164:0/769887877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe554004520 msgr2=0x7fe5540049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:42.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe567fff700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe554004520 0x7fe5540049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe567fff700 1 -- 172.21.15.164:0/769887877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5540037c0 msgr2=0x7fe554003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:42.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe567fff700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5540037c0 0x7fe554003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.121 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe567fff700 1 -- 172.21.15.164:0/769887877 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe554003280 con 0x7fe554004e90 2020-11-20T11:50:42.121 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe567fff700 1 -- 172.21.15.164:0/769887877 reap_dead start 2020-11-20T11:50:42.122 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe567fff700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe554004e90 0x7fe55400b770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fe56000c840 tx=0x7fe5680815a0).ready entity=mon.1 client_cookie=29b6bebb126d8124 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.122 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560007b90 con 0x7fe554004e90 2020-11-20T11:50:42.122 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe560005bc0 con 0x7fe554004e90 2020-11-20T11:50:42.123 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe5667fc700 1 -- 172.21.15.164:0/769887877 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5600070d0 con 0x7fe554004e90 2020-11-20T11:50:42.123 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe56cc8d700 1 -- 172.21.15.164:0/769887877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe554004e90 msgr2=0x7fe55400b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.124 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.094+0000 7fe56cc8d700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe554004e90 0x7fe55400b770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fe56000c840 tx=0x7fe5680815a0).stop 2020-11-20T11:50:42.124 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.095+0000 7fe56cc8d700 1 -- 172.21.15.164:0/769887877 shutdown_connections 2020-11-20T11:50:42.124 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.095+0000 7fe56cc8d700 1 --2- 172.21.15.164:0/769887877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe554004e90 0x7fe55400b770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.125 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.095+0000 7fe56cc8d700 1 -- 172.21.15.164:0/769887877 >> 172.21.15.164:0/769887877 conn(0x7fe56807ffb0 msgr2=0x7fe5680803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:42.125 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.095+0000 7fe56cc8d700 1 -- 172.21.15.164:0/769887877 shutdown_connections 2020-11-20T11:50:42.126 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.095+0000 7fe56cc8d700 1 -- 172.21.15.164:0/769887877 wait complete. 2020-11-20T11:50:42.126 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.096+0000 7fe56cc8d700 1 Processor -- start 2020-11-20T11:50:42.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.096+0000 7fe56cc8d700 1 -- start start 2020-11-20T11:50:42.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe56cc8d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe554004e90 0x7fe568061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe56cc8d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe568061c80 0x7fe5680c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe56cc8d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5680c1850 0x7fe5680c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe56cc8d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680c5fb0 con 0x7fe554004e90 2020-11-20T11:50:42.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe56cc8d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe568163500 con 0x7fe568061c80 2020-11-20T11:50:42.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe56cc8d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5681637a0 con 0x7fe5680c1850 2020-11-20T11:50:42.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe566ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe568061c80 0x7fe5680c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.130 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe566ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe568061c80 0x7fe5680c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45356/0 (socket says 172.21.15.164:45356) 2020-11-20T11:50:42.130 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe566ffd700 1 -- 172.21.15.164:0/3910574550 learned_addr learned my addr 172.21.15.164:0/3910574550 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:42.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe5677fe700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe554004e90 0x7fe568061790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe567fff700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5680c1850 0x7fe5680c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe566ffd700 1 -- 172.21.15.164:0/3910574550 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5680c1850 msgr2=0x7fe5680c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe566ffd700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5680c1850 0x7fe5680c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe566ffd700 1 -- 172.21.15.164:0/3910574550 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe554004e90 msgr2=0x7fe568061790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe566ffd700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe554004e90 0x7fe568061790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe566ffd700 1 -- 172.21.15.164:0/3910574550 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568163a40 con 0x7fe568061c80 2020-11-20T11:50:42.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe567fff700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5680c1850 0x7fe5680c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:42.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe5677fe700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe554004e90 0x7fe568061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:42.133 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe566ffd700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe568061c80 0x7fe5680c54e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fe5580068a0 tx=0x7fe558006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.133 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe5477fe700 1 -- 172.21.15.164:0/3910574550 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558018070 con 0x7fe568061c80 2020-11-20T11:50:42.133 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe5477fe700 1 -- 172.21.15.164:0/3910574550 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558000e90 con 0x7fe568061c80 2020-11-20T11:50:42.133 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe56cc8d700 1 -- 172.21.15.164:0/3910574550 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe568163ce0 con 0x7fe568061c80 2020-11-20T11:50:42.133 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe5477fe700 1 -- 172.21.15.164:0/3910574550 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800fd60 con 0x7fe568061c80 2020-11-20T11:50:42.134 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.097+0000 7fe56cc8d700 1 -- 172.21.15.164:0/3910574550 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe568164220 con 0x7fe568061c80 2020-11-20T11:50:42.134 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.098+0000 7fe56cc8d700 1 -- 172.21.15.164:0/3910574550 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56805cf90 con 0x7fe568061c80 2020-11-20T11:50:42.134 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.099+0000 7fe5477fe700 1 -- 172.21.15.164:0/3910574550 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe558014650 con 0x7fe568061c80 2020-11-20T11:50:42.134 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.099+0000 7fe5477fe700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe540080670 0x7fe540082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.134 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.099+0000 7fe5477fe700 1 -- 172.21.15.164:0/3910574550 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fe5580a3120 con 0x7fe568061c80 2020-11-20T11:50:42.135 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.099+0000 7fe5677fe700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe540080670 0x7fe540082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.135 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.100+0000 7fe5677fe700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe540080670 0x7fe540082b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe55c000c00 tx=0x7fe55c009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.135 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.103+0000 7fe5477fe700 1 -- 172.21.15.164:0/3910574550 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe558077ab0 con 0x7fe568061c80 2020-11-20T11:50:42.247 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.245+0000 7fe56cc8d700 1 -- 172.21.15.164:0/3910574550 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe568044fa0 con 0x7fe568061c80 2020-11-20T11:50:42.248 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.246+0000 7fe5477fe700 1 -- 172.21.15.164:0/3910574550 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7fe55807b0d0 con 0x7fe568061c80 2020-11-20T11:50:42.248 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:39.612589+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:50:34.615204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:50:37.302647+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:42.250 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 -- 172.21.15.164:0/3910574550 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe540080670 msgr2=0x7fe540082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.250 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe540080670 0x7fe540082b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe55c000c00 tx=0x7fe55c009040).stop 2020-11-20T11:50:42.250 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 -- 172.21.15.164:0/3910574550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe568061c80 msgr2=0x7fe5680c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.251 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe568061c80 0x7fe5680c54e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fe5580068a0 tx=0x7fe558006e30).stop 2020-11-20T11:50:42.251 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 -- 172.21.15.164:0/3910574550 shutdown_connections 2020-11-20T11:50:42.251 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe540080670 0x7fe540082b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.251 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5680c1850 0x7fe5680c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.251 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe554004e90 0x7fe568061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.252 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 --2- 172.21.15.164:0/3910574550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe568061c80 0x7fe5680c54e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.252 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 -- 172.21.15.164:0/3910574550 >> 172.21.15.164:0/3910574550 conn(0x7fe56807ffb0 msgr2=0x7fe56809fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:42.252 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 -- 172.21.15.164:0/3910574550 shutdown_connections 2020-11-20T11:50:42.252 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.247+0000 7fe56cc8d700 1 -- 172.21.15.164:0/3910574550 wait complete. 2020-11-20T11:50:42.262 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:42.262 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-11-20T11:50:42.371 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.368+0000 7fe767180700 1 Processor -- start 2020-11-20T11:50:42.371 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.368+0000 7fe767180700 1 -- start start 2020-11-20T11:50:42.373 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe767180700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe7600bfd80 0x7fe7600c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.373 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe767180700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe7600c4790 0x7fe760150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.373 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe767180700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7601516d0 con 0x7fe7600bf9a0 2020-11-20T11:50:42.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe767180700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe760151970 con 0x7fe7600bfd80 2020-11-20T11:50:42.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe767180700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe760151c10 con 0x7fe7600c4790 2020-11-20T11:50:42.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe75ffff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe7600bfd80 0x7fe7600c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe75ffff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe7600bfd80 0x7fe7600c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45362/0 (socket says 172.21.15.164:45362) 2020-11-20T11:50:42.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe75ffff700 1 -- 172.21.15.164:0/448849265 learned_addr learned my addr 172.21.15.164:0/448849265 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:42.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe76571d700 1 --2- 172.21.15.164:0/448849265 >> v2:172.21.15.188:3300/0 conn(0x7fe7600c4790 0x7fe760150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe75ffff700 1 -- 172.21.15.164:0/448849265 >> v2:172.21.15.188:3300/0 conn(0x7fe7600c4790 msgr2=0x7fe760150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:42.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe75ffff700 1 --2- 172.21.15.164:0/448849265 >> v2:172.21.15.188:3300/0 conn(0x7fe7600c4790 0x7fe760150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe75ffff700 1 -- 172.21.15.164:0/448849265 >> v1:172.21.15.36:6789/0 conn(0x7fe7600bf9a0 legacy=0x7fe7600c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:42.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe75ffff700 1 -- 172.21.15.164:0/448849265 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760151eb0 con 0x7fe7600bfd80 2020-11-20T11:50:42.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe75ffff700 1 --2- 172.21.15.164:0/448849265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 0x7fe7600c42a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe7600686b0 tx=0x7fe74c006ef0).ready entity=mon.1 client_cookie=2f65bae6420c6c66 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe75f7fe700 1 -- 172.21.15.164:0/448849265 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00b820 con 0x7fe7600bfd80 2020-11-20T11:50:42.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.369+0000 7fe75f7fe700 1 -- 172.21.15.164:0/448849265 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c000e90 con 0x7fe7600bfd80 2020-11-20T11:50:42.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.370+0000 7fe75f7fe700 1 -- 172.21.15.164:0/448849265 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00bb90 con 0x7fe7600bfd80 2020-11-20T11:50:42.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.370+0000 7fe767180700 1 -- 172.21.15.164:0/448849265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 msgr2=0x7fe7600c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.370+0000 7fe767180700 1 --2- 172.21.15.164:0/448849265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 0x7fe7600c42a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe7600686b0 tx=0x7fe74c006ef0).stop 2020-11-20T11:50:42.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.370+0000 7fe767180700 1 -- 172.21.15.164:0/448849265 shutdown_connections 2020-11-20T11:50:42.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.370+0000 7fe767180700 1 --2- 172.21.15.164:0/448849265 >> v2:172.21.15.188:3300/0 conn(0x7fe7600c4790 0x7fe760150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.370+0000 7fe767180700 1 --2- 172.21.15.164:0/448849265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 0x7fe7600c42a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.370+0000 7fe767180700 1 -- 172.21.15.164:0/448849265 >> 172.21.15.164:0/448849265 conn(0x7fe7600678e0 msgr2=0x7fe760067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:42.378 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.370+0000 7fe767180700 1 -- 172.21.15.164:0/448849265 shutdown_connections 2020-11-20T11:50:42.378 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.370+0000 7fe767180700 1 -- 172.21.15.164:0/448849265 wait complete. 2020-11-20T11:50:42.380 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.371+0000 7fe767180700 1 Processor -- start 2020-11-20T11:50:42.380 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.371+0000 7fe767180700 1 -- start start 2020-11-20T11:50:42.381 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe767180700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7600bf9a0 0x7fe760163880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.381 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe767180700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 0x7fe760152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.381 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe767180700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7600c4790 0x7fe760111f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.381 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe767180700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe760112400 con 0x7fe7600c4790 2020-11-20T11:50:42.381 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe767180700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe760163e60 con 0x7fe7600bfd80 2020-11-20T11:50:42.382 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe767180700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe760164100 con 0x7fe7600bf9a0 2020-11-20T11:50:42.382 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe75ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 0x7fe760152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.382 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe75ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 0x7fe760152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45370/0 (socket says 172.21.15.164:45370) 2020-11-20T11:50:42.382 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe75ffff700 1 -- 172.21.15.164:0/4120708320 learned_addr learned my addr 172.21.15.164:0/4120708320 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:42.382 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe764f1c700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7600bf9a0 0x7fe760163880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.383 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe75ffff700 1 -- 172.21.15.164:0/4120708320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7600bf9a0 msgr2=0x7fe760163880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.383 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe75ffff700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7600bf9a0 0x7fe760163880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.383 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe75ffff700 1 -- 172.21.15.164:0/4120708320 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7600c4790 msgr2=0x7fe760111f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.383 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe75ffff700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7600c4790 0x7fe760111f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:42.383 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe75ffff700 1 -- 172.21.15.164:0/4120708320 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7601643a0 con 0x7fe7600bfd80 2020-11-20T11:50:42.384 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.372+0000 7fe75ffff700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 0x7fe760152e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fe760062a30 tx=0x7fe74c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.384 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.373+0000 7fe75cff9700 1 -- 172.21.15.164:0/4120708320 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c011b70 con 0x7fe7600bfd80 2020-11-20T11:50:42.384 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.373+0000 7fe75cff9700 1 -- 172.21.15.164:0/4120708320 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c011cd0 con 0x7fe7600bfd80 2020-11-20T11:50:42.388 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.373+0000 7fe75cff9700 1 -- 172.21.15.164:0/4120708320 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c01c690 con 0x7fe7600bfd80 2020-11-20T11:50:42.389 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.373+0000 7fe767180700 1 -- 172.21.15.164:0/4120708320 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe760164640 con 0x7fe7600bfd80 2020-11-20T11:50:42.389 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.373+0000 7fe767180700 1 -- 172.21.15.164:0/4120708320 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7600c66c0 con 0x7fe7600bfd80 2020-11-20T11:50:42.390 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.374+0000 7fe767180700 1 -- 172.21.15.164:0/4120708320 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7600c6850 con 0x7fe7600bfd80 2020-11-20T11:50:42.390 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.374+0000 7fe75cff9700 1 -- 172.21.15.164:0/4120708320 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe74c017040 con 0x7fe7600bfd80 2020-11-20T11:50:42.391 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.375+0000 7fe75cff9700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe738080670 0x7fe738082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.391 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.375+0000 7fe764f1c700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe738080670 0x7fe738082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.375+0000 7fe75cff9700 1 -- 172.21.15.164:0/4120708320 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fe74c0a4380 con 0x7fe7600bfd80 2020-11-20T11:50:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.375+0000 7fe764f1c700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe738080670 0x7fe738082b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe754003750 tx=0x7fe754007bb0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.378+0000 7fe75cff9700 1 -- 172.21.15.164:0/4120708320 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe74c078d10 con 0x7fe7600bfd80 2020-11-20T11:50:42.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.518+0000 7fe767180700 1 -- 172.21.15.164:0/4120708320 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe760069b70 con 0x7fe7600bfd80 2020-11-20T11:50:42.521 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.519+0000 7fe75cff9700 1 -- 172.21.15.164:0/4120708320 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7fe74c015030 con 0x7fe7600bfd80 2020-11-20T11:50:42.522 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:42.522 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:39.612589+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:50:34.615204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:50:37.302647+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:42.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 -- 172.21.15.164:0/4120708320 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe738080670 msgr2=0x7fe738082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe738080670 0x7fe738082b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe754003750 tx=0x7fe754007bb0).stop 2020-11-20T11:50:42.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 -- 172.21.15.164:0/4120708320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 msgr2=0x7fe760152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 0x7fe760152e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fe760062a30 tx=0x7fe74c016000).stop 2020-11-20T11:50:42.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 -- 172.21.15.164:0/4120708320 shutdown_connections 2020-11-20T11:50:42.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe738080670 0x7fe738082b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7600c4790 0x7fe760111f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:42.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7600bf9a0 0x7fe760163880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 --2- 172.21.15.164:0/4120708320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7600bfd80 0x7fe760152e60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 -- 172.21.15.164:0/4120708320 >> 172.21.15.164:0/4120708320 conn(0x7fe7600678e0 msgr2=0x7fe7600c4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:42.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 -- 172.21.15.164:0/4120708320 shutdown_connections 2020-11-20T11:50:42.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.520+0000 7fe767180700 1 -- 172.21.15.164:0/4120708320 wait complete. 2020-11-20T11:50:42.535 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:50:22.130897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:50:32.016548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:50:34.615204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:50:37.302647+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:50:42.535 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:50:42.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.649+0000 7f83ac541700 1 Processor -- start 2020-11-20T11:50:42.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.649+0000 7f83ac541700 1 -- start start 2020-11-20T11:50:42.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83ac541700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f83a40c4470 0x7f83a40c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83ac541700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a41555a0 con 0x7f83a40bccf0 2020-11-20T11:50:42.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83ac541700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a41517d0 con 0x7f83a40bf680 2020-11-20T11:50:42.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83ac541700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a4151a70 con 0x7f83a40c4470 2020-11-20T11:50:42.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83aaade700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f83a40bf680 0x7f83a41504b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.164:40432/0 (socket says 172.21.15.164:40432) 2020-11-20T11:50:42.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83aaade700 1 -- 172.21.15.164:0/2927596654 learned_addr learned my addr 172.21.15.164:0/2927596654 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:42.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83aa2dd700 1 --2- 172.21.15.164:0/2927596654 >> v2:172.21.15.36:3300/0 conn(0x7f83a40c4470 0x7f83a40c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83a92db700 1 -- 172.21.15.164:0/2927596654 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520287821 0 0) 0x7f83a41517d0 con 0x7f83a40bf680 2020-11-20T11:50:42.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83a92db700 1 -- 172.21.15.164:0/2927596654 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f838c003280 con 0x7f83a40bf680 2020-11-20T11:50:42.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83aa2dd700 1 -- 172.21.15.164:0/2927596654 >> v1:172.21.15.188:6789/0 conn(0x7f83a40bf680 legacy=0x7f83a41504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83aa2dd700 1 -- 172.21.15.164:0/2927596654 >> v1:172.21.15.36:6789/0 conn(0x7f83a40bccf0 legacy=0x7f83a40c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.650+0000 7f83aa2dd700 1 -- 172.21.15.164:0/2927596654 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a4151d10 con 0x7f83a40c4470 2020-11-20T11:50:42.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83aa2dd700 1 --2- 172.21.15.164:0/2927596654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83a40c4470 0x7f83a40c4850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f83a0006fd0 tx=0x7f83a0006e30).ready entity=mon.0 client_cookie=a825bae5698e3082 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83a92db700 1 -- 172.21.15.164:0/2927596654 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0009870 con 0x7f83a40c4470 2020-11-20T11:50:42.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83a92db700 1 -- 172.21.15.164:0/2927596654 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a0000e90 con 0x7f83a40c4470 2020-11-20T11:50:42.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83a92db700 1 -- 172.21.15.164:0/2927596654 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0009be0 con 0x7f83a40c4470 2020-11-20T11:50:42.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83ac541700 1 -- 172.21.15.164:0/2927596654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83a40c4470 msgr2=0x7f83a40c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83ac541700 1 --2- 172.21.15.164:0/2927596654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83a40c4470 0x7f83a40c4850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f83a0006fd0 tx=0x7f83a0006e30).stop 2020-11-20T11:50:42.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83ac541700 1 -- 172.21.15.164:0/2927596654 shutdown_connections 2020-11-20T11:50:42.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83ac541700 1 --2- 172.21.15.164:0/2927596654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83a40c4470 0x7f83a40c4850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83ac541700 1 -- 172.21.15.164:0/2927596654 >> 172.21.15.164:0/2927596654 conn(0x7f83a40683b0 msgr2=0x7f83a4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:42.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83ac541700 1 -- 172.21.15.164:0/2927596654 shutdown_connections 2020-11-20T11:50:42.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.651+0000 7f83ac541700 1 -- 172.21.15.164:0/2927596654 wait complete. 2020-11-20T11:50:42.662 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.652+0000 7f83ac541700 1 Processor -- start 2020-11-20T11:50:42.662 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.652+0000 7f83ac541700 1 -- start start 2020-11-20T11:50:42.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83ac541700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a40bccf0 0x7f83a4164490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83ac541700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83a40bf680 0x7f83a4112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83ac541700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83a40c4470 0x7f83a4157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83ac541700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4160560 con 0x7f83a40bf680 2020-11-20T11:50:42.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83ac541700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4164980 con 0x7f83a40bccf0 2020-11-20T11:50:42.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83ac541700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4161410 con 0x7f83a40c4470 2020-11-20T11:50:42.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83aa2dd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a40bccf0 0x7f83a4164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83aa2dd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a40bccf0 0x7f83a4164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45380/0 (socket says 172.21.15.164:45380) 2020-11-20T11:50:42.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83aa2dd700 1 -- 172.21.15.164:0/181278618 learned_addr learned my addr 172.21.15.164:0/181278618 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:42.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83aaade700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83a40c4470 0x7f83a4157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83a9adc700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83a40bf680 0x7f83a4112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83aa2dd700 1 -- 172.21.15.164:0/181278618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83a40c4470 msgr2=0x7f83a4157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83aa2dd700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83a40c4470 0x7f83a4157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83aa2dd700 1 -- 172.21.15.164:0/181278618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83a40bf680 msgr2=0x7f83a4112770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.666 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.653+0000 7f83aa2dd700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83a40bf680 0x7f83a4112770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.666 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.654+0000 7f83aa2dd700 1 -- 172.21.15.164:0/181278618 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a4112f10 con 0x7f83a40bccf0 2020-11-20T11:50:42.666 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.654+0000 7f83a9adc700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83a40bf680 0x7f83a4112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:42.666 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.654+0000 7f83aa2dd700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a40bccf0 0x7f83a4164490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f83a4081c50 tx=0x7f83a0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.666 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.654+0000 7f83927fc700 1 -- 172.21.15.164:0/181278618 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0011d50 con 0x7f83a40bccf0 2020-11-20T11:50:42.667 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.654+0000 7f83927fc700 1 -- 172.21.15.164:0/181278618 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a001d3c0 con 0x7f83a40bccf0 2020-11-20T11:50:42.667 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.654+0000 7f83ac541700 1 -- 172.21.15.164:0/181278618 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a4160790 con 0x7f83a40bccf0 2020-11-20T11:50:42.667 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.654+0000 7f83927fc700 1 -- 172.21.15.164:0/181278618 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a001d740 con 0x7f83a40bccf0 2020-11-20T11:50:42.667 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.654+0000 7f83ac541700 1 -- 172.21.15.164:0/181278618 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a4160cd0 con 0x7f83a40bccf0 2020-11-20T11:50:42.667 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.655+0000 7f83ac541700 1 -- 172.21.15.164:0/181278618 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a40c4f00 con 0x7f83a40bccf0 2020-11-20T11:50:42.668 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.655+0000 7f83927fc700 1 -- 172.21.15.164:0/181278618 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f83a001a040 con 0x7f83a40bccf0 2020-11-20T11:50:42.668 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.656+0000 7f83927fc700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f837c080670 0x7f837c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.668 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.656+0000 7f83927fc700 1 -- 172.21.15.164:0/181278618 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f83a00a3f40 con 0x7f83a40bccf0 2020-11-20T11:50:42.668 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.656+0000 7f83a9adc700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f837c080670 0x7f837c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.668 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.656+0000 7f83a9adc700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f837c080670 0x7f837c082b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8394007fd0 tx=0x7f8394009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.669 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.659+0000 7f83927fc700 1 -- 172.21.15.164:0/181278618 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f83a00788d0 con 0x7f83a40bccf0 2020-11-20T11:50:42.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.796+0000 7f83ac541700 1 -- 172.21.15.164:0/181278618 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f83a4112c60 con 0x7f83a40bccf0 2020-11-20T11:50:42.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.797+0000 7f83927fc700 1 -- 172.21.15.164:0/181278618 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7f83a00a1e60 con 0x7f83a40bccf0 2020-11-20T11:50:42.801 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2020-11-20T11:50:42.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 -- 172.21.15.164:0/181278618 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f837c080670 msgr2=0x7f837c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f837c080670 0x7f837c082b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8394007fd0 tx=0x7f8394009040).stop 2020-11-20T11:50:42.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 -- 172.21.15.164:0/181278618 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a40bccf0 msgr2=0x7f83a4164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a40bccf0 0x7f83a4164490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f83a4081c50 tx=0x7f83a0015000).stop 2020-11-20T11:50:42.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 -- 172.21.15.164:0/181278618 shutdown_connections 2020-11-20T11:50:42.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f837c080670 0x7f837c082b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.804 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a40bccf0 0x7f83a4164490 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.804 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83a40c4470 0x7f83a4157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.804 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 --2- 172.21.15.164:0/181278618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83a40bf680 0x7f83a4112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.804 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 -- 172.21.15.164:0/181278618 >> 172.21.15.164:0/181278618 conn(0x7f83a40683b0 msgr2=0x7f83a40c21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:42.804 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 -- 172.21.15.164:0/181278618 shutdown_connections 2020-11-20T11:50:42.805 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.798+0000 7f83ac541700 1 -- 172.21.15.164:0/181278618 wait complete. 2020-11-20T11:50:42.814 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:50:42.931 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.927+0000 7fb690986700 1 Processor -- start 2020-11-20T11:50:42.932 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.927+0000 7fb690986700 1 -- start start 2020-11-20T11:50:42.932 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.928+0000 7fb690986700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb68c0c0300 0x7fb68c0be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.928+0000 7fb690986700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb68c14a1d0 0x7fb68c14a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.928+0000 7fb690986700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c067620 con 0x7fb68c0bff20 2020-11-20T11:50:42.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.928+0000 7fb690986700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c0687e0 con 0x7fb68c14a1d0 2020-11-20T11:50:42.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.928+0000 7fb690986700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c0678c0 con 0x7fb68c0c0300 2020-11-20T11:50:42.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.928+0000 7fb68bfff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb68c14a1d0 0x7fb68c14a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.928+0000 7fb68bfff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb68c14a1d0 0x7fb68c14a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45390/0 (socket says 172.21.15.164:45390) 2020-11-20T11:50:42.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.928+0000 7fb68bfff700 1 -- 172.21.15.164:0/1404820629 learned_addr learned my addr 172.21.15.164:0/1404820629 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:42.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb68bfff700 1 -- 172.21.15.164:0/1404820629 >> v2:172.21.15.188:3300/0 conn(0x7fb68c0c0300 msgr2=0x7fb68c0be3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:42.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb68affd700 1 --2- 172.21.15.164:0/1404820629 >> v2:172.21.15.188:3300/0 conn(0x7fb68c0c0300 0x7fb68c0be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb68bfff700 1 --2- 172.21.15.164:0/1404820629 >> v2:172.21.15.188:3300/0 conn(0x7fb68c0c0300 0x7fb68c0be3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb68bfff700 1 -- 172.21.15.164:0/1404820629 >> v1:172.21.15.188:6789/0 conn(0x7fb68c0bff20 legacy=0x7fb68c0bdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:42.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb68bfff700 1 -- 172.21.15.164:0/1404820629 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c067b60 con 0x7fb68c14a1d0 2020-11-20T11:50:42.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb68affd700 1 --2- 172.21.15.164:0/1404820629 >> v2:172.21.15.188:3300/0 conn(0x7fb68c0c0300 0x7fb68c0be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:42.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb68bfff700 1 --2- 172.21.15.164:0/1404820629 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c14a1d0 0x7fb68c14a620 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb68c066be0 tx=0x7fb6840092d0).ready entity=mon.1 client_cookie=45946f2091c70edd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb68a7fc700 1 -- 172.21.15.164:0/1404820629 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68400bc40 con 0x7fb68c14a1d0 2020-11-20T11:50:42.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb68a7fc700 1 -- 172.21.15.164:0/1404820629 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68400bda0 con 0x7fb68c14a1d0 2020-11-20T11:50:42.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb68a7fc700 1 -- 172.21.15.164:0/1404820629 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684011610 con 0x7fb68c14a1d0 2020-11-20T11:50:42.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb690986700 1 -- 172.21.15.164:0/1404820629 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c14a1d0 msgr2=0x7fb68c14a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb690986700 1 --2- 172.21.15.164:0/1404820629 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c14a1d0 0x7fb68c14a620 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb68c066be0 tx=0x7fb6840092d0).stop 2020-11-20T11:50:42.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb690986700 1 -- 172.21.15.164:0/1404820629 shutdown_connections 2020-11-20T11:50:42.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb690986700 1 --2- 172.21.15.164:0/1404820629 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c14a1d0 0x7fb68c14a620 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb690986700 1 --2- 172.21.15.164:0/1404820629 >> v2:172.21.15.188:3300/0 conn(0x7fb68c0c0300 0x7fb68c0be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb690986700 1 -- 172.21.15.164:0/1404820629 >> 172.21.15.164:0/1404820629 conn(0x7fb68c05bac0 msgr2=0x7fb68c0601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:42.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb690986700 1 -- 172.21.15.164:0/1404820629 shutdown_connections 2020-11-20T11:50:42.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.929+0000 7fb690986700 1 -- 172.21.15.164:0/1404820629 wait complete. 2020-11-20T11:50:42.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.931+0000 7fb690986700 1 Processor -- start 2020-11-20T11:50:42.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.931+0000 7fb690986700 1 -- start start 2020-11-20T11:50:42.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.931+0000 7fb690986700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c0bff20 0x7fb68c13cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.931+0000 7fb690986700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb68c0c0300 0x7fb68c13f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.931+0000 7fb690986700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb68c14a1d0 0x7fb68c13f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.931+0000 7fb690986700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c15dd10 con 0x7fb68c14a1d0 2020-11-20T11:50:42.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.931+0000 7fb690986700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c15cff0 con 0x7fb68c0bff20 2020-11-20T11:50:42.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.931+0000 7fb690986700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c15d290 con 0x7fb68c0c0300 2020-11-20T11:50:42.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb68b7fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c0bff20 0x7fb68c13cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb68b7fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c0bff20 0x7fb68c13cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45396/0 (socket says 172.21.15.164:45396) 2020-11-20T11:50:42.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb68b7fe700 1 -- 172.21.15.164:0/2173652217 learned_addr learned my addr 172.21.15.164:0/2173652217 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:42.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb68affd700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb68c0c0300 0x7fb68c13f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb68b7fe700 1 -- 172.21.15.164:0/2173652217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb68c0c0300 msgr2=0x7fb68c13f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb68b7fe700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb68c0c0300 0x7fb68c13f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:42.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb68b7fe700 1 -- 172.21.15.164:0/2173652217 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb68c14a1d0 msgr2=0x7fb68c13f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:42.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb68b7fe700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb68c14a1d0 0x7fb68c13f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:42.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb68b7fe700 1 -- 172.21.15.164:0/2173652217 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c15d530 con 0x7fb68c0bff20 2020-11-20T11:50:42.947 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb68b7fe700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c0bff20 0x7fb68c13cba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb67c00c730 tx=0x7fb67c007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.947 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb66b7fe700 1 -- 172.21.15.164:0/2173652217 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c010510 con 0x7fb68c0bff20 2020-11-20T11:50:42.947 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb66b7fe700 1 -- 172.21.15.164:0/2173652217 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c010690 con 0x7fb68c0bff20 2020-11-20T11:50:42.947 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb66b7fe700 1 -- 172.21.15.164:0/2173652217 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c010a50 con 0x7fb68c0bff20 2020-11-20T11:50:42.948 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb690986700 1 -- 172.21.15.164:0/2173652217 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c15d7d0 con 0x7fb68c0bff20 2020-11-20T11:50:42.948 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.932+0000 7fb690986700 1 -- 172.21.15.164:0/2173652217 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c150500 con 0x7fb68c0bff20 2020-11-20T11:50:42.948 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.933+0000 7fb690986700 1 -- 172.21.15.164:0/2173652217 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c0ba250 con 0x7fb68c0bff20 2020-11-20T11:50:42.948 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.934+0000 7fb66b7fe700 1 -- 172.21.15.164:0/2173652217 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb67c010070 con 0x7fb68c0bff20 2020-11-20T11:50:42.948 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.934+0000 7fb66b7fe700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb664080670 0x7fb664082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:42.949 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.934+0000 7fb66b7fe700 1 -- 172.21.15.164:0/2173652217 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb67c0a2580 con 0x7fb68c0bff20 2020-11-20T11:50:42.949 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.934+0000 7fb68affd700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb664080670 0x7fb664082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:42.949 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.934+0000 7fb68affd700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb664080670 0x7fb664082b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb68c0c1d90 tx=0x7fb680008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:42.950 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:42.937+0000 7fb66b7fe700 1 -- 172.21.15.164:0/2173652217 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb67c076f90 con 0x7fb68c0bff20 2020-11-20T11:50:43.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.078+0000 7fb690986700 1 -- 172.21.15.164:0/2173652217 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb68c044fa0 con 0x7fb68c0bff20 2020-11-20T11:50:43.083 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.079+0000 7fb66b7fe700 1 -- 172.21.15.164:0/2173652217 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb67c007d90 con 0x7fb68c0bff20 2020-11-20T11:50:43.083 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 8 2020-11-20T11:50:43.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 -- 172.21.15.164:0/2173652217 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb664080670 msgr2=0x7fb664082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb664080670 0x7fb664082b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb68c0c1d90 tx=0x7fb680008040).stop 2020-11-20T11:50:43.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 -- 172.21.15.164:0/2173652217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c0bff20 msgr2=0x7fb68c13cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c0bff20 0x7fb68c13cba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb67c00c730 tx=0x7fb67c007c70).stop 2020-11-20T11:50:43.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 -- 172.21.15.164:0/2173652217 shutdown_connections 2020-11-20T11:50:43.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb664080670 0x7fb664082b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb68c0bff20 0x7fb68c13cba0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb68c14a1d0 0x7fb68c13f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:43.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 --2- 172.21.15.164:0/2173652217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb68c0c0300 0x7fb68c13f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 -- 172.21.15.164:0/2173652217 >> 172.21.15.164:0/2173652217 conn(0x7fb68c05bac0 msgr2=0x7fb68c0c2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:43.087 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 -- 172.21.15.164:0/2173652217 shutdown_connections 2020-11-20T11:50:43.087 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.081+0000 7fb690986700 1 -- 172.21.15.164:0/2173652217 wait complete. 2020-11-20T11:50:43.096 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:50:43.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.208+0000 7fa9d72d7700 1 Processor -- start 2020-11-20T11:50:43.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.208+0000 7fa9d72d7700 1 -- start start 2020-11-20T11:50:43.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.209+0000 7fa9d72d7700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa9d0150d00 0x7fa9d0062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.209+0000 7fa9d72d7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d0062a60 con 0x7fa9d00650f0 2020-11-20T11:50:43.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.209+0000 7fa9d72d7700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d0062520 con 0x7fa9d0064d10 2020-11-20T11:50:43.224 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.209+0000 7fa9d72d7700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d00627c0 con 0x7fa9d0150d00 2020-11-20T11:50:43.224 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.209+0000 7fa9d5073700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fa9d0064d10 0x7fa9d00baf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55142/0 (socket says 172.21.15.164:55142) 2020-11-20T11:50:43.224 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.209+0000 7fa9d5073700 1 -- 172.21.15.164:0/1919383433 learned_addr learned my addr 172.21.15.164:0/1919383433 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:43.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.209+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418616255 0 0) 0x7fa9d0062520 con 0x7fa9d0064d10 2020-11-20T11:50:43.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.209+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b8003280 con 0x7fa9d0064d10 2020-11-20T11:50:43.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.209+0000 7fa9d5874700 1 --2- 172.21.15.164:0/1919383433 >> v2:172.21.15.36:3300/0 conn(0x7fa9d0150d00 0x7fa9d0062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3311080895 0 0) 0x7fa9b8003280 con 0x7fa9d0064d10 2020-11-20T11:50:43.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 >> v2:172.21.15.36:3300/0 conn(0x7fa9d0150d00 msgr2=0x7fa9d0062ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:43.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 --2- 172.21.15.164:0/1919383433 >> v2:172.21.15.36:3300/0 conn(0x7fa9d0150d00 0x7fa9d0062ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 >> v1:172.21.15.36:6789/0 conn(0x7fa9d00650f0 legacy=0x7fa9d01505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0151260 con 0x7fa9d0064d10 2020-11-20T11:50:43.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fa9cc001520 con 0x7fa9d0064d10 2020-11-20T11:50:43.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 >> v1:172.21.15.164:6789/0 conn(0x7fa9d0064d10 legacy=0x7fa9d00baf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 --2- 172.21.15.164:0/1919383433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9b80037c0 0x7fa9b8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 --2- 172.21.15.164:0/1919383433 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9b8004520 0x7fa9b80049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 --2- 172.21.15.164:0/1919383433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9b8004e90 0x7fa9b800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00627c0 con 0x7fa9b80037c0 2020-11-20T11:50:43.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b8005340 con 0x7fa9b8004e90 2020-11-20T11:50:43.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b800bc60 con 0x7fa9b8004520 2020-11-20T11:50:43.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9d5874700 1 --2- 172.21.15.164:0/1919383433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9b8004e90 0x7fa9b800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9d5073700 1 --2- 172.21.15.164:0/1919383433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9b80037c0 0x7fa9b8003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9d5874700 1 -- 172.21.15.164:0/1919383433 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9b8004520 msgr2=0x7fa9b80049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:43.232 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9d5874700 1 --2- 172.21.15.164:0/1919383433 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9b8004520 0x7fa9b80049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:43.232 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9d5874700 1 -- 172.21.15.164:0/1919383433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9b80037c0 msgr2=0x7fa9b8003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:43.232 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9d5874700 1 --2- 172.21.15.164:0/1919383433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9b80037c0 0x7fa9b8003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.233 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9d5874700 1 -- 172.21.15.164:0/1919383433 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8003280 con 0x7fa9b8004e90 2020-11-20T11:50:43.233 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9d5874700 1 -- 172.21.15.164:0/1919383433 reap_dead start 2020-11-20T11:50:43.233 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9d5874700 1 --2- 172.21.15.164:0/1919383433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9b8004e90 0x7fa9b800b770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa9c8009ec0 tx=0x7fa9c8009220).ready entity=mon.1 client_cookie=588bb5a9165befd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:43.234 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8009610 con 0x7fa9b8004e90 2020-11-20T11:50:43.234 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c800ed30 con 0x7fa9b8004e90 2020-11-20T11:50:43.234 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.210+0000 7fa9bffff700 1 -- 172.21.15.164:0/1919383433 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8012600 con 0x7fa9b8004e90 2020-11-20T11:50:43.235 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.211+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1919383433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9b8004e90 msgr2=0x7fa9b800b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.235 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.211+0000 7fa9d72d7700 1 --2- 172.21.15.164:0/1919383433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9b8004e90 0x7fa9b800b770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa9c8009ec0 tx=0x7fa9c8009220).stop 2020-11-20T11:50:43.236 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.211+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1919383433 shutdown_connections 2020-11-20T11:50:43.236 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.211+0000 7fa9d72d7700 1 --2- 172.21.15.164:0/1919383433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9b8004e90 0x7fa9b800b770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.236 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.211+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1919383433 >> 172.21.15.164:0/1919383433 conn(0x7fa9d00c55c0 msgr2=0x7fa9d00c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:43.236 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.211+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1919383433 shutdown_connections 2020-11-20T11:50:43.237 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.211+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1919383433 wait complete. 2020-11-20T11:50:43.237 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.212+0000 7fa9d72d7700 1 Processor -- start 2020-11-20T11:50:43.238 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.212+0000 7fa9d72d7700 1 -- start start 2020-11-20T11:50:43.238 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d72d7700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9b8004e90 0x7fa9d0153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.238 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d72d7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d0160500 0x7fa9d00c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.239 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d72d7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9d00c4d30 0x7fa9d01640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.239 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d72d7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0163a20 con 0x7fa9d00c4d30 2020-11-20T11:50:43.239 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d72d7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0153c40 con 0x7fa9d0160500 2020-11-20T11:50:43.240 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d72d7700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0153ee0 con 0x7fa9b8004e90 2020-11-20T11:50:43.240 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d4872700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d0160500 0x7fa9d00c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.240 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d4872700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d0160500 0x7fa9d00c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45414/0 (socket says 172.21.15.164:45414) 2020-11-20T11:50:43.241 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d4872700 1 -- 172.21.15.164:0/1614308027 learned_addr learned my addr 172.21.15.164:0/1614308027 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:43.241 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d5073700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9b8004e90 0x7fa9d0153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.242 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d5874700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9d00c4d30 0x7fa9d01640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.242 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d4872700 1 -- 172.21.15.164:0/1614308027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9b8004e90 msgr2=0x7fa9d0153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.242 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d4872700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9b8004e90 0x7fa9d0153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.243 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d4872700 1 -- 172.21.15.164:0/1614308027 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9d00c4d30 msgr2=0x7fa9d01640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.243 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d4872700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9d00c4d30 0x7fa9d01640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.243 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d4872700 1 -- 172.21.15.164:0/1614308027 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0154180 con 0x7fa9d0160500 2020-11-20T11:50:43.244 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d5073700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9b8004e90 0x7fa9d0153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:43.244 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d5874700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9d00c4d30 0x7fa9d01640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:43.244 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.213+0000 7fa9d4872700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d0160500 0x7fa9d00c4840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fa9c000c740 tx=0x7fa9c0007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:43.245 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.214+0000 7fa9bd7fa700 1 -- 172.21.15.164:0/1614308027 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0010510 con 0x7fa9d0160500 2020-11-20T11:50:43.245 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.214+0000 7fa9bd7fa700 1 -- 172.21.15.164:0/1614308027 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c0010670 con 0x7fa9d0160500 2020-11-20T11:50:43.245 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.214+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1614308027 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d0154420 con 0x7fa9d0160500 2020-11-20T11:50:43.246 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.214+0000 7fa9bd7fa700 1 -- 172.21.15.164:0/1614308027 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0010a30 con 0x7fa9d0160500 2020-11-20T11:50:43.246 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.214+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1614308027 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d0114380 con 0x7fa9d0160500 2020-11-20T11:50:43.246 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.215+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1614308027 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d0069b70 con 0x7fa9d0160500 2020-11-20T11:50:43.247 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.215+0000 7fa9bd7fa700 1 -- 172.21.15.164:0/1614308027 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa9c0010070 con 0x7fa9d0160500 2020-11-20T11:50:43.247 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.216+0000 7fa9bd7fa700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9a8080670 0x7fa9a8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.247 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.216+0000 7fa9bd7fa700 1 -- 172.21.15.164:0/1614308027 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa9c00a1fe0 con 0x7fa9d0160500 2020-11-20T11:50:43.248 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.216+0000 7fa9d5073700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9a8080670 0x7fa9a8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.248 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.216+0000 7fa9d5073700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9a8080670 0x7fa9a8082b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa9cc0077e0 tx=0x7fa9cc009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:43.249 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.219+0000 7fa9bd7fa700 1 -- 172.21.15.164:0/1614308027 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa9c00769f0 con 0x7fa9d0160500 2020-11-20T11:50:43.284 INFO:tasks.ceph.mds.b.smithi036.stderr:2020-11-20T11:50:43.278+0000 7efee0d52700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2020-11-20T11:50:43.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.359+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1614308027 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9d00bc790 con 0x7fa9d0160500 2020-11-20T11:50:43.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.359+0000 7fa9bd7fa700 1 -- 172.21.15.164:0/1614308027 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa9c0007d60 con 0x7fa9d0160500 2020-11-20T11:50:43.364 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 8 2020-11-20T11:50:43.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.360+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1614308027 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9a8080670 msgr2=0x7fa9a8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.360+0000 7fa9d72d7700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9a8080670 0x7fa9a8082b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa9cc0077e0 tx=0x7fa9cc009040).stop 2020-11-20T11:50:43.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.360+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1614308027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d0160500 msgr2=0x7fa9d00c4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.360+0000 7fa9d72d7700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d0160500 0x7fa9d00c4840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fa9c000c740 tx=0x7fa9c0007c40).stop 2020-11-20T11:50:43.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.360+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1614308027 shutdown_connections 2020-11-20T11:50:43.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.360+0000 7fa9d72d7700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa9a8080670 0x7fa9a8082b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.360+0000 7fa9d72d7700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9d00c4d30 0x7fa9d01640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.360+0000 7fa9d72d7700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9b8004e90 0x7fa9d0153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.360+0000 7fa9d72d7700 1 --2- 172.21.15.164:0/1614308027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9d0160500 0x7fa9d00c4840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.361+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1614308027 >> 172.21.15.164:0/1614308027 conn(0x7fa9d00c55c0 msgr2=0x7fa9d00c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:43.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.361+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1614308027 shutdown_connections 2020-11-20T11:50:43.369 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.361+0000 7fa9d72d7700 1 -- 172.21.15.164:0/1614308027 wait complete. 2020-11-20T11:50:43.375 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:50:43.490 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.485+0000 7f25b9e47700 1 Processor -- start 2020-11-20T11:50:43.491 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.485+0000 7f25b9e47700 1 -- start start 2020-11-20T11:50:43.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.486+0000 7f25b9e47700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f25b40c4470 0x7f25b40c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.486+0000 7f25b9e47700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f25b40bccf0 0x7f25b40c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.486+0000 7f25b9e47700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b41555a0 con 0x7f25b40c10e0 2020-11-20T11:50:43.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.486+0000 7f25b9e47700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b41517d0 con 0x7f25b40bccf0 2020-11-20T11:50:43.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.486+0000 7f25b9e47700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b4151a70 con 0x7f25b40c4470 2020-11-20T11:50:43.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.486+0000 7f25b37fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f25b40c4470 0x7f25b40c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.486+0000 7f25b37fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f25b40c4470 0x7f25b40c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45426/0 (socket says 172.21.15.164:45426) 2020-11-20T11:50:43.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.486+0000 7f25b37fe700 1 -- 172.21.15.164:0/1672499255 learned_addr learned my addr 172.21.15.164:0/1672499255 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:43.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.486+0000 7f25b2ffd700 1 --2- 172.21.15.164:0/1672499255 >> v2:172.21.15.36:3300/0 conn(0x7f25b40bccf0 0x7f25b40c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b37fe700 1 -- 172.21.15.164:0/1672499255 >> v2:172.21.15.36:3300/0 conn(0x7f25b40bccf0 msgr2=0x7f25b40c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:43.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b37fe700 1 --2- 172.21.15.164:0/1672499255 >> v2:172.21.15.36:3300/0 conn(0x7f25b40bccf0 0x7f25b40c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b37fe700 1 -- 172.21.15.164:0/1672499255 >> v1:172.21.15.36:6789/0 conn(0x7f25b40c10e0 legacy=0x7f25b40bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b37fe700 1 -- 172.21.15.164:0/1672499255 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b4151d10 con 0x7f25b40c4470 2020-11-20T11:50:43.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b37fe700 1 --2- 172.21.15.164:0/1672499255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c4470 0x7f25b40c4850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f25b4081020 tx=0x7f25a4006ef0).ready entity=mon.1 client_cookie=438b62ee59ebaead server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:43.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b27fc700 1 -- 172.21.15.164:0/1672499255 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a400b8f0 con 0x7f25b40c4470 2020-11-20T11:50:43.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b27fc700 1 -- 172.21.15.164:0/1672499255 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4000e90 con 0x7f25b40c4470 2020-11-20T11:50:43.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b27fc700 1 -- 172.21.15.164:0/1672499255 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a400bc60 con 0x7f25b40c4470 2020-11-20T11:50:43.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b9e47700 1 -- 172.21.15.164:0/1672499255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c4470 msgr2=0x7f25b40c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b9e47700 1 --2- 172.21.15.164:0/1672499255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c4470 0x7f25b40c4850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f25b4081020 tx=0x7f25a4006ef0).stop 2020-11-20T11:50:43.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b9e47700 1 -- 172.21.15.164:0/1672499255 shutdown_connections 2020-11-20T11:50:43.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b9e47700 1 --2- 172.21.15.164:0/1672499255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c4470 0x7f25b40c4850 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b9e47700 1 --2- 172.21.15.164:0/1672499255 >> v2:172.21.15.36:3300/0 conn(0x7f25b40bccf0 0x7f25b40c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.487+0000 7f25b9e47700 1 -- 172.21.15.164:0/1672499255 >> 172.21.15.164:0/1672499255 conn(0x7f25b40683b0 msgr2=0x7f25b4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:43.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.488+0000 7f25b9e47700 1 -- 172.21.15.164:0/1672499255 shutdown_connections 2020-11-20T11:50:43.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.488+0000 7f25b9e47700 1 -- 172.21.15.164:0/1672499255 wait complete. 2020-11-20T11:50:43.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.489+0000 7f25b9e47700 1 Processor -- start 2020-11-20T11:50:43.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.489+0000 7f25b9e47700 1 -- start start 2020-11-20T11:50:43.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.489+0000 7f25b9e47700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25b40bccf0 0x7f25b4160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b9e47700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c10e0 0x7f25b4157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b9e47700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25b40c4470 0x7f25b40c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b9e47700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4161300 con 0x7f25b40bccf0 2020-11-20T11:50:43.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b9e47700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4160b20 con 0x7f25b40c10e0 2020-11-20T11:50:43.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b9e47700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4160dc0 con 0x7f25b40c4470 2020-11-20T11:50:43.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b2ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c10e0 0x7f25b4157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b2ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c10e0 0x7f25b4157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45432/0 (socket says 172.21.15.164:45432) 2020-11-20T11:50:43.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b2ffd700 1 -- 172.21.15.164:0/4004669873 learned_addr learned my addr 172.21.15.164:0/4004669873 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:43.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b37fe700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25b40bccf0 0x7f25b4160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b3fff700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25b40c4470 0x7f25b40c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b2ffd700 1 -- 172.21.15.164:0/4004669873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25b40c4470 msgr2=0x7f25b40c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b2ffd700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25b40c4470 0x7f25b40c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b2ffd700 1 -- 172.21.15.164:0/4004669873 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25b40bccf0 msgr2=0x7f25b4160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b2ffd700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25b40bccf0 0x7f25b4160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.517 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b2ffd700 1 -- 172.21.15.164:0/4004669873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b4161060 con 0x7f25b40c10e0 2020-11-20T11:50:43.517 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b2ffd700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c10e0 0x7f25b4157cb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f25a800eba0 tx=0x7f25a8006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:43.517 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25937fe700 1 -- 172.21.15.164:0/4004669873 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a800c9b0 con 0x7f25b40c10e0 2020-11-20T11:50:43.518 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25937fe700 1 -- 172.21.15.164:0/4004669873 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a800cb10 con 0x7f25b40c10e0 2020-11-20T11:50:43.518 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b9e47700 1 -- 172.21.15.164:0/4004669873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b41618f0 con 0x7f25b40c10e0 2020-11-20T11:50:43.518 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25937fe700 1 -- 172.21.15.164:0/4004669873 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a800ce90 con 0x7f25b40c10e0 2020-11-20T11:50:43.519 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.490+0000 7f25b9e47700 1 -- 172.21.15.164:0/4004669873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b4160820 con 0x7f25b40c10e0 2020-11-20T11:50:43.519 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.491+0000 7f25b9e47700 1 -- 172.21.15.164:0/4004669873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b4069b70 con 0x7f25b40c10e0 2020-11-20T11:50:43.519 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.492+0000 7f25937fe700 1 -- 172.21.15.164:0/4004669873 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f25a8012600 con 0x7f25b40c10e0 2020-11-20T11:50:43.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.492+0000 7f25937fe700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f258c0806a0 0x7f258c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.492+0000 7f25937fe700 1 -- 172.21.15.164:0/4004669873 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f25a80a3920 con 0x7f25b40c10e0 2020-11-20T11:50:43.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.492+0000 7f25b37fe700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f258c0806a0 0x7f258c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.521 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.493+0000 7f25b37fe700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f258c0806a0 0x7f258c082b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f25a4006f30 tx=0x7f25a4016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:43.521 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.495+0000 7f25937fe700 1 -- 172.21.15.164:0/4004669873 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f25a80782b0 con 0x7f25b40c10e0 2020-11-20T11:50:43.642 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.638+0000 7f25b9e47700 1 -- 172.21.15.164:0/4004669873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25b405d590 con 0x7f25b40c10e0 2020-11-20T11:50:43.642 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.638+0000 7f25937fe700 1 -- 172.21.15.164:0/4004669873 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7f25a8019310 con 0x7f25b40c10e0 2020-11-20T11:50:43.642 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 8 2020-11-20T11:50:43.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 -- 172.21.15.164:0/4004669873 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f258c0806a0 msgr2=0x7f258c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f258c0806a0 0x7f258c082b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f25a4006f30 tx=0x7f25a4016000).stop 2020-11-20T11:50:43.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 -- 172.21.15.164:0/4004669873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c10e0 msgr2=0x7f25b4157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c10e0 0x7f25b4157cb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f25a800eba0 tx=0x7f25a8006e30).stop 2020-11-20T11:50:43.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 -- 172.21.15.164:0/4004669873 shutdown_connections 2020-11-20T11:50:43.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f258c0806a0 0x7f258c082b60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25b40c4470 0x7f25b40c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25b40bccf0 0x7f25b4160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 --2- 172.21.15.164:0/4004669873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f25b40c10e0 0x7f25b4157cb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 -- 172.21.15.164:0/4004669873 >> 172.21.15.164:0/4004669873 conn(0x7f25b40683b0 msgr2=0x7f25b4150280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:43.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 -- 172.21.15.164:0/4004669873 shutdown_connections 2020-11-20T11:50:43.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.640+0000 7f25b9e47700 1 -- 172.21.15.164:0/4004669873 wait complete. 2020-11-20T11:50:43.656 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-20T11:50:43.659 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-11-20T11:50:43.660 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-11-20T11:50:43.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.773+0000 7fd21a081700 1 Processor -- start 2020-11-20T11:50:43.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.773+0000 7fd21a081700 1 -- start start 2020-11-20T11:50:43.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd21a081700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd2140c4360 0x7fd2140c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd21a081700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd214150520 0x7fd214150950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd21a081700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd214151220 con 0x7fd2141550f0 2020-11-20T11:50:43.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd21a081700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140bd090 con 0x7fd214150520 2020-11-20T11:50:43.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd21a081700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2141514c0 con 0x7fd2140c4360 2020-11-20T11:50:43.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd213fff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd214150520 0x7fd214150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd213fff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd214150520 0x7fd214150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45436/0 (socket says 172.21.15.164:45436) 2020-11-20T11:50:43.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd213fff700 1 -- 172.21.15.164:0/4053171638 learned_addr learned my addr 172.21.15.164:0/4053171638 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:43.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd213fff700 1 -- 172.21.15.164:0/4053171638 >> v2:172.21.15.188:3300/0 conn(0x7fd2140c4360 msgr2=0x7fd2140c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:43.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd213fff700 1 --2- 172.21.15.164:0/4053171638 >> v2:172.21.15.188:3300/0 conn(0x7fd2140c4360 0x7fd2140c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:43.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd213fff700 1 -- 172.21.15.164:0/4053171638 >> v1:172.21.15.188:6789/0 conn(0x7fd2141550f0 legacy=0x7fd2140bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:43.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd213fff700 1 -- 172.21.15.164:0/4053171638 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214151760 con 0x7fd214150520 2020-11-20T11:50:43.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.774+0000 7fd213fff700 1 --2- 172.21.15.164:0/4053171638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 0x7fd214150950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd214063350 tx=0x7fd20c0092d0).ready entity=mon.1 client_cookie=24bea30a2c89e7e1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:43.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd2127fc700 1 -- 172.21.15.164:0/4053171638 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00bbb0 con 0x7fd214150520 2020-11-20T11:50:43.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd2127fc700 1 -- 172.21.15.164:0/4053171638 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c00bd10 con 0x7fd214150520 2020-11-20T11:50:43.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd2127fc700 1 -- 172.21.15.164:0/4053171638 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c011610 con 0x7fd214150520 2020-11-20T11:50:43.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd21a081700 1 -- 172.21.15.164:0/4053171638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 msgr2=0x7fd214150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd21a081700 1 --2- 172.21.15.164:0/4053171638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 0x7fd214150950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd214063350 tx=0x7fd20c0092d0).stop 2020-11-20T11:50:43.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd21a081700 1 -- 172.21.15.164:0/4053171638 shutdown_connections 2020-11-20T11:50:43.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd21a081700 1 --2- 172.21.15.164:0/4053171638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 0x7fd214150950 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd21a081700 1 --2- 172.21.15.164:0/4053171638 >> v2:172.21.15.188:3300/0 conn(0x7fd2140c4360 0x7fd2140c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:43.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd21a081700 1 -- 172.21.15.164:0/4053171638 >> 172.21.15.164:0/4053171638 conn(0x7fd2140619e0 msgr2=0x7fd214061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:43.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd21a081700 1 -- 172.21.15.164:0/4053171638 shutdown_connections 2020-11-20T11:50:43.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.775+0000 7fd21a081700 1 -- 172.21.15.164:0/4053171638 wait complete. 2020-11-20T11:50:43.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.776+0000 7fd21a081700 1 Processor -- start 2020-11-20T11:50:43.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.776+0000 7fd21a081700 1 -- start start 2020-11-20T11:50:43.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.777+0000 7fd21a081700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2140c4360 0x7fd2141564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.777+0000 7fd21a081700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 0x7fd214160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.777+0000 7fd21a081700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2141550f0 0x7fd214156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.777+0000 7fd21a081700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2141125b0 con 0x7fd2140c4360 2020-11-20T11:50:43.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.777+0000 7fd21a081700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd214112850 con 0x7fd214150520 2020-11-20T11:50:43.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.777+0000 7fd21a081700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd214155af0 con 0x7fd2141550f0 2020-11-20T11:50:43.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.777+0000 7fd212ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 0x7fd214160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.777+0000 7fd212ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 0x7fd214160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45442/0 (socket says 172.21.15.164:45442) 2020-11-20T11:50:43.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.777+0000 7fd212ffd700 1 -- 172.21.15.164:0/758223705 learned_addr learned my addr 172.21.15.164:0/758223705 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:43.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.777+0000 7fd213fff700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2141550f0 0x7fd214156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd212ffd700 1 -- 172.21.15.164:0/758223705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2141550f0 msgr2=0x7fd214156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd212ffd700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2141550f0 0x7fd214156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd212ffd700 1 -- 172.21.15.164:0/758223705 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2140c4360 msgr2=0x7fd2141564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd212ffd700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2140c4360 0x7fd2141564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:43.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd212ffd700 1 -- 172.21.15.164:0/758223705 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214155d90 con 0x7fd214150520 2020-11-20T11:50:43.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd213fff700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2141550f0 0x7fd214156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:43.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd212ffd700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 0x7fd214160d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd204009730 tx=0x7fd204006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:43.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd20b7fe700 1 -- 172.21.15.164:0/758223705 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400d520 con 0x7fd214150520 2020-11-20T11:50:43.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd20b7fe700 1 -- 172.21.15.164:0/758223705 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400d6c0 con 0x7fd214150520 2020-11-20T11:50:43.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd20b7fe700 1 -- 172.21.15.164:0/758223705 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400da80 con 0x7fd214150520 2020-11-20T11:50:43.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd21a081700 1 -- 172.21.15.164:0/758223705 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd214156030 con 0x7fd214150520 2020-11-20T11:50:43.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.778+0000 7fd21a081700 1 -- 172.21.15.164:0/758223705 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2141122a0 con 0x7fd214150520 2020-11-20T11:50:43.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.779+0000 7fd21a081700 1 -- 172.21.15.164:0/758223705 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd214069b70 con 0x7fd214150520 2020-11-20T11:50:43.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.779+0000 7fd20b7fe700 1 -- 172.21.15.164:0/758223705 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd204012440 con 0x7fd214150520 2020-11-20T11:50:43.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.780+0000 7fd20b7fe700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd1f0080670 0x7fd1f0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:43.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.780+0000 7fd20b7fe700 1 -- 172.21.15.164:0/758223705 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd2040a3350 con 0x7fd214150520 2020-11-20T11:50:43.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.780+0000 7fd2137fe700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd1f0080670 0x7fd1f0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:43.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.780+0000 7fd2137fe700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd1f0080670 0x7fd1f0082b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd1fc0094e0 tx=0x7fd1fc006a20).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:43.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.783+0000 7fd20b7fe700 1 -- 172.21.15.164:0/758223705 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd204077d00 con 0x7fd214150520 2020-11-20T11:50:43.960 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.956+0000 7fd21a081700 1 -- 172.21.15.164:0/758223705 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd2141561c0 con 0x7fd214150520 2020-11-20T11:50:43.967 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.960+0000 7fd20b7fe700 1 -- 172.21.15.164:0/758223705 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+202043 (secure 0 0 0) 0x7fd20407b320 con 0x7fd214150520 2020-11-20T11:50:43.968 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:43.970 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 -- 172.21.15.164:0/758223705 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd1f0080670 msgr2=0x7fd1f0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.971 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd1f0080670 0x7fd1f0082b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd1fc0094e0 tx=0x7fd1fc006a20).stop 2020-11-20T11:50:43.971 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 -- 172.21.15.164:0/758223705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 msgr2=0x7fd214160d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:43.971 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 0x7fd214160d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd204009730 tx=0x7fd204006e30).stop 2020-11-20T11:50:43.971 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 -- 172.21.15.164:0/758223705 shutdown_connections 2020-11-20T11:50:43.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd1f0080670 0x7fd1f0082b30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2141550f0 0x7fd214156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2140c4360 0x7fd2141564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:43.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 --2- 172.21.15.164:0/758223705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd214150520 0x7fd214160d90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:43.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 -- 172.21.15.164:0/758223705 >> 172.21.15.164:0/758223705 conn(0x7fd2140619e0 msgr2=0x7fd2140c3450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:43.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 -- 172.21.15.164:0/758223705 shutdown_connections 2020-11-20T11:50:43.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:43.962+0000 7fd21a081700 1 -- 172.21.15.164:0/758223705 wait complete. 2020-11-20T11:50:43.979 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":4,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":22952},{"type":"v1","addr":"172.21.15.164:6801","nonce":22952}]},"active_addr":"172.21.15.164:6801/22952","active_change":"2020-11-20T11:50:22.079784+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4107,"name":"z","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2353394929}]},{"addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":62686013}]},{"addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":3070900366}]}]}} 2020-11-20T11:50:43.990 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-11-20T11:50:43.991 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-20T11:50:43.991 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:44.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.124+0000 7ffa9ffca700 1 Processor -- start 2020-11-20T11:50:44.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.124+0000 7ffa9ffca700 1 -- start start 2020-11-20T11:50:44.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.125+0000 7ffa9ffca700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ffa980c49b0 0x7ffa9815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.130 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.125+0000 7ffa9ffca700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa981516d0 con 0x7ffa980bfd80 2020-11-20T11:50:44.130 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.125+0000 7ffa9ffca700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa98151970 con 0x7ffa980bf9a0 2020-11-20T11:50:44.130 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.125+0000 7ffa9ffca700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa98151c10 con 0x7ffa980c49b0 2020-11-20T11:50:44.130 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.125+0000 7ffa9d565700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ffa980bfd80 0x7ffa980c42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.164:41320/0 (socket says 172.21.15.164:41320) 2020-11-20T11:50:44.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.125+0000 7ffa9d565700 1 -- 172.21.15.164:0/3479564938 learned_addr learned my addr 172.21.15.164:0/3479564938 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:44.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.125+0000 7ffa9e567700 1 --2- 172.21.15.164:0/3479564938 >> v2:172.21.15.188:3300/0 conn(0x7ffa980c49b0 0x7ffa9815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9cd64700 1 -- 172.21.15.164:0/3479564938 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007901883 0 0) 0x7ffa981516d0 con 0x7ffa980bfd80 2020-11-20T11:50:44.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9cd64700 1 -- 172.21.15.164:0/3479564938 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa80003280 con 0x7ffa980bfd80 2020-11-20T11:50:44.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9e567700 1 -- 172.21.15.164:0/3479564938 >> v1:172.21.15.188:6789/0 conn(0x7ffa980bf9a0 legacy=0x7ffa980c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9e567700 1 -- 172.21.15.164:0/3479564938 >> v1:172.21.15.36:6789/0 conn(0x7ffa980bfd80 legacy=0x7ffa980c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9e567700 1 -- 172.21.15.164:0/3479564938 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98151eb0 con 0x7ffa980c49b0 2020-11-20T11:50:44.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9e567700 1 --2- 172.21.15.164:0/3479564938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa980c49b0 0x7ffa9815b9f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ffa90009ce0 tx=0x7ffa90009220).ready entity=mon.2 client_cookie=a0a27d229503856f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9cd64700 1 -- 172.21.15.164:0/3479564938 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000ba40 con 0x7ffa980c49b0 2020-11-20T11:50:44.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9cd64700 1 -- 172.21.15.164:0/3479564938 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9000bba0 con 0x7ffa980c49b0 2020-11-20T11:50:44.133 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9cd64700 1 -- 172.21.15.164:0/3479564938 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90011400 con 0x7ffa980c49b0 2020-11-20T11:50:44.136 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9ffca700 1 -- 172.21.15.164:0/3479564938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa980c49b0 msgr2=0x7ffa9815b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.136 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.126+0000 7ffa9ffca700 1 --2- 172.21.15.164:0/3479564938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa980c49b0 0x7ffa9815b9f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ffa90009ce0 tx=0x7ffa90009220).stop 2020-11-20T11:50:44.136 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.127+0000 7ffa9ffca700 1 -- 172.21.15.164:0/3479564938 shutdown_connections 2020-11-20T11:50:44.137 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.127+0000 7ffa9ffca700 1 --2- 172.21.15.164:0/3479564938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa980c49b0 0x7ffa9815b9f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.137 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.127+0000 7ffa9ffca700 1 -- 172.21.15.164:0/3479564938 >> 172.21.15.164:0/3479564938 conn(0x7ffa980678e0 msgr2=0x7ffa98067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:44.137 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.127+0000 7ffa9ffca700 1 -- 172.21.15.164:0/3479564938 shutdown_connections 2020-11-20T11:50:44.137 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.127+0000 7ffa9ffca700 1 -- 172.21.15.164:0/3479564938 wait complete. 2020-11-20T11:50:44.137 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.128+0000 7ffa9ffca700 1 Processor -- start 2020-11-20T11:50:44.138 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.128+0000 7ffa9ffca700 1 -- start start 2020-11-20T11:50:44.138 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.128+0000 7ffa9ffca700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa980bf9a0 0x7ffa981133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.138 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.128+0000 7ffa9ffca700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa980bfd80 0x7ffa981521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.138 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.128+0000 7ffa9ffca700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa980c49b0 0x7ffa981526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.138 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.128+0000 7ffa9ffca700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98153f40 con 0x7ffa980bf9a0 2020-11-20T11:50:44.139 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.128+0000 7ffa9ffca700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98152d20 con 0x7ffa980bfd80 2020-11-20T11:50:44.139 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.128+0000 7ffa9ffca700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98152fc0 con 0x7ffa980c49b0 2020-11-20T11:50:44.139 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9d565700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa980bfd80 0x7ffa981521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.139 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9d565700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa980bfd80 0x7ffa981521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45454/0 (socket says 172.21.15.164:45454) 2020-11-20T11:50:44.139 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9d565700 1 -- 172.21.15.164:0/1116643380 learned_addr learned my addr 172.21.15.164:0/1116643380 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:44.140 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9dd66700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa980bf9a0 0x7ffa981133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.140 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9e567700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa980c49b0 0x7ffa981526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.140 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9d565700 1 -- 172.21.15.164:0/1116643380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa980c49b0 msgr2=0x7ffa981526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.140 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9d565700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa980c49b0 0x7ffa981526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.140 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9d565700 1 -- 172.21.15.164:0/1116643380 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa980bf9a0 msgr2=0x7ffa981133a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.141 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9d565700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa980bf9a0 0x7ffa981133a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.141 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9d565700 1 -- 172.21.15.164:0/1116643380 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98153260 con 0x7ffa980bfd80 2020-11-20T11:50:44.141 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9d565700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa980bfd80 0x7ffa981521b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7ffa8800c770 tx=0x7ffa88007b10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.141 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa85ffb700 1 -- 172.21.15.164:0/1116643380 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880072e0 con 0x7ffa980bfd80 2020-11-20T11:50:44.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa85ffb700 1 -- 172.21.15.164:0/1116643380 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa88007440 con 0x7ffa980bfd80 2020-11-20T11:50:44.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9ffca700 1 -- 172.21.15.164:0/1116643380 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa98153500 con 0x7ffa980bfd80 2020-11-20T11:50:44.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa85ffb700 1 -- 172.21.15.164:0/1116643380 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88005840 con 0x7ffa980bfd80 2020-11-20T11:50:44.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.129+0000 7ffa9ffca700 1 -- 172.21.15.164:0/1116643380 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa98153a40 con 0x7ffa980bfd80 2020-11-20T11:50:44.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.130+0000 7ffa9ffca700 1 -- 172.21.15.164:0/1116643380 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa98069b70 con 0x7ffa980bfd80 2020-11-20T11:50:44.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.131+0000 7ffa85ffb700 1 -- 172.21.15.164:0/1116643380 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ffa88010070 con 0x7ffa980bfd80 2020-11-20T11:50:44.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.131+0000 7ffa85ffb700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ffa70080670 0x7ffa70082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.131+0000 7ffa85ffb700 1 -- 172.21.15.164:0/1116643380 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ffa880a21c0 con 0x7ffa980bfd80 2020-11-20T11:50:44.144 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.131+0000 7ffa9dd66700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ffa70080670 0x7ffa70082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.144 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.132+0000 7ffa9dd66700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ffa70080670 0x7ffa70082b30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ffa940036e0 tx=0x7ffa94007bb0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.144 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.135+0000 7ffa85ffb700 1 -- 172.21.15.164:0/1116643380 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ffa88076bd0 con 0x7ffa980bfd80 2020-11-20T11:50:44.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.278+0000 7ffa9ffca700 1 -- 172.21.15.164:0/1116643380 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa98060540 con 0x7ffa980bfd80 2020-11-20T11:50:44.282 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.279+0000 7ffa85ffb700 1 -- 172.21.15.164:0/1116643380 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7ffa8807a1f0 con 0x7ffa980bfd80 2020-11-20T11:50:44.282 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:44.283 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:39.612589+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:50:34.615204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:50:37.302647+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:44.284 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.280+0000 7ffa9ffca700 1 -- 172.21.15.164:0/1116643380 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ffa70080670 msgr2=0x7ffa70082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.285 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.280+0000 7ffa9ffca700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ffa70080670 0x7ffa70082b30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ffa940036e0 tx=0x7ffa94007bb0).stop 2020-11-20T11:50:44.285 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.280+0000 7ffa9ffca700 1 -- 172.21.15.164:0/1116643380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa980bfd80 msgr2=0x7ffa981521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.285 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.280+0000 7ffa9ffca700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa980bfd80 0x7ffa981521b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7ffa8800c770 tx=0x7ffa88007b10).stop 2020-11-20T11:50:44.285 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.280+0000 7ffa9ffca700 1 -- 172.21.15.164:0/1116643380 shutdown_connections 2020-11-20T11:50:44.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.280+0000 7ffa9ffca700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ffa70080670 0x7ffa70082b30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.280+0000 7ffa9ffca700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa980c49b0 0x7ffa981526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.280+0000 7ffa9ffca700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa980bf9a0 0x7ffa981133a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.280+0000 7ffa9ffca700 1 --2- 172.21.15.164:0/1116643380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa980bfd80 0x7ffa981521b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.280+0000 7ffa9ffca700 1 -- 172.21.15.164:0/1116643380 >> 172.21.15.164:0/1116643380 conn(0x7ffa980678e0 msgr2=0x7ffa9814d380 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:44.287 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.281+0000 7ffa9ffca700 1 -- 172.21.15.164:0/1116643380 shutdown_connections 2020-11-20T11:50:44.287 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.281+0000 7ffa9ffca700 1 -- 172.21.15.164:0/1116643380 wait complete. 2020-11-20T11:50:44.296 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-20T11:50:44.296 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:44.405 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.402+0000 7f5e8afcc700 1 Processor -- start 2020-11-20T11:50:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.402+0000 7f5e8afcc700 1 -- start start 2020-11-20T11:50:44.409 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8afcc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5e840bdfc0 0x7f5e8409e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.409 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8afcc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5e8409e560 0x7f5e84150610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.409 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8afcc700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e841512d0 con 0x7f5e840bdbe0 2020-11-20T11:50:44.409 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8afcc700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e84151570 con 0x7f5e840bdfc0 2020-11-20T11:50:44.410 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8afcc700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e84151810 con 0x7f5e8409e560 2020-11-20T11:50:44.410 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e89fca700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f5e840bdbe0 0x7f5e8409ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55202/0 (socket says 172.21.15.164:55202) 2020-11-20T11:50:44.410 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e89fca700 1 -- 172.21.15.164:0/2451456965 learned_addr learned my addr 172.21.15.164:0/2451456965 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:44.410 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8a7cb700 1 --2- 172.21.15.164:0/2451456965 >> v2:172.21.15.164:3300/0 conn(0x7f5e8409e560 0x7f5e84150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e897c9700 1 --2- 172.21.15.164:0/2451456965 >> v2:172.21.15.36:3300/0 conn(0x7f5e840bdfc0 0x7f5e8409e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e88fc8700 1 -- 172.21.15.164:0/2451456965 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156047090 0 0) 0x7f5e841512d0 con 0x7f5e840bdbe0 2020-11-20T11:50:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e88fc8700 1 -- 172.21.15.164:0/2451456965 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e6c003280 con 0x7f5e840bdbe0 2020-11-20T11:50:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8a7cb700 1 -- 172.21.15.164:0/2451456965 >> v2:172.21.15.36:3300/0 conn(0x7f5e840bdfc0 msgr2=0x7f5e8409e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8a7cb700 1 --2- 172.21.15.164:0/2451456965 >> v2:172.21.15.36:3300/0 conn(0x7f5e840bdfc0 0x7f5e8409e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.412 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8a7cb700 1 -- 172.21.15.164:0/2451456965 >> v1:172.21.15.164:6789/0 conn(0x7f5e840bdbe0 legacy=0x7f5e8409ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.412 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8a7cb700 1 -- 172.21.15.164:0/2451456965 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84151ab0 con 0x7f5e8409e560 2020-11-20T11:50:44.412 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.403+0000 7f5e8a7cb700 1 --2- 172.21.15.164:0/2451456965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 0x7f5e84150610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5e840690f0 tx=0x7f5e7c009220).ready entity=mon.1 client_cookie=962a86112ae81b23 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.413 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e88fc8700 1 -- 172.21.15.164:0/2451456965 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00b950 con 0x7f5e8409e560 2020-11-20T11:50:44.414 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e88fc8700 1 -- 172.21.15.164:0/2451456965 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c00bab0 con 0x7f5e8409e560 2020-11-20T11:50:44.415 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e88fc8700 1 -- 172.21.15.164:0/2451456965 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00be30 con 0x7f5e8409e560 2020-11-20T11:50:44.415 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e8afcc700 1 -- 172.21.15.164:0/2451456965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 msgr2=0x7f5e84150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.415 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e8afcc700 1 --2- 172.21.15.164:0/2451456965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 0x7f5e84150610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5e840690f0 tx=0x7f5e7c009220).stop 2020-11-20T11:50:44.415 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e8afcc700 1 -- 172.21.15.164:0/2451456965 shutdown_connections 2020-11-20T11:50:44.416 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e8afcc700 1 --2- 172.21.15.164:0/2451456965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 0x7f5e84150610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.416 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e8afcc700 1 --2- 172.21.15.164:0/2451456965 >> v2:172.21.15.36:3300/0 conn(0x7f5e840bdfc0 0x7f5e8409e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.416 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e8afcc700 1 -- 172.21.15.164:0/2451456965 >> 172.21.15.164:0/2451456965 conn(0x7f5e8407ffb0 msgr2=0x7f5e840803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:44.416 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e8afcc700 1 -- 172.21.15.164:0/2451456965 shutdown_connections 2020-11-20T11:50:44.417 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.404+0000 7f5e8afcc700 1 -- 172.21.15.164:0/2451456965 wait complete. 2020-11-20T11:50:44.417 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.405+0000 7f5e8afcc700 1 Processor -- start 2020-11-20T11:50:44.417 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.405+0000 7f5e8afcc700 1 -- start start 2020-11-20T11:50:44.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e8afcc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 0x7f5e84156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.419 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e8afcc700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840bdbe0 0x7f5e840befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e8afcc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e840bdfc0 0x7f5e84153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e8afcc700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840bf4b0 con 0x7f5e840bdfc0 2020-11-20T11:50:44.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e8afcc700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84152f10 con 0x7f5e8409e560 2020-11-20T11:50:44.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e8afcc700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84164fe0 con 0x7f5e840bdbe0 2020-11-20T11:50:44.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e89fca700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 0x7f5e84156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e89fca700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 0x7f5e84156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45468/0 (socket says 172.21.15.164:45468) 2020-11-20T11:50:44.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e89fca700 1 -- 172.21.15.164:0/1884373722 learned_addr learned my addr 172.21.15.164:0/1884373722 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:44.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e8a7cb700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e840bdfc0 0x7f5e84153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e897c9700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840bdbe0 0x7f5e840befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e89fca700 1 -- 172.21.15.164:0/1884373722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840bdbe0 msgr2=0x7f5e840befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e89fca700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840bdbe0 0x7f5e840befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e89fca700 1 -- 172.21.15.164:0/1884373722 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e840bdfc0 msgr2=0x7f5e84153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e89fca700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e840bdfc0 0x7f5e84153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e89fca700 1 -- 172.21.15.164:0/1884373722 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84165280 con 0x7f5e8409e560 2020-11-20T11:50:44.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.406+0000 7f5e89fca700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 0x7f5e84156450 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5e7400c6e0 tx=0x7f5e740028b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.407+0000 7f5e71ffb700 1 -- 172.21.15.164:0/1884373722 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74007320 con 0x7f5e8409e560 2020-11-20T11:50:44.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.407+0000 7f5e71ffb700 1 -- 172.21.15.164:0/1884373722 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e74005500 con 0x7f5e8409e560 2020-11-20T11:50:44.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.407+0000 7f5e8afcc700 1 -- 172.21.15.164:0/1884373722 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e84153140 con 0x7f5e8409e560 2020-11-20T11:50:44.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.407+0000 7f5e71ffb700 1 -- 172.21.15.164:0/1884373722 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74005880 con 0x7f5e8409e560 2020-11-20T11:50:44.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.407+0000 7f5e8afcc700 1 -- 172.21.15.164:0/1884373722 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e84153680 con 0x7f5e8409e560 2020-11-20T11:50:44.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.408+0000 7f5e8afcc700 1 -- 172.21.15.164:0/1884373722 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e84153880 con 0x7f5e8409e560 2020-11-20T11:50:44.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.408+0000 7f5e71ffb700 1 -- 172.21.15.164:0/1884373722 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5e74010030 con 0x7f5e8409e560 2020-11-20T11:50:44.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.409+0000 7f5e71ffb700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e5c080670 0x7f5e5c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.409+0000 7f5e71ffb700 1 -- 172.21.15.164:0/1884373722 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f5e740a2720 con 0x7f5e8409e560 2020-11-20T11:50:44.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.409+0000 7f5e897c9700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e5c080670 0x7f5e5c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.425 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.409+0000 7f5e897c9700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e5c080670 0x7f5e5c082b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5e8409db40 tx=0x7f5e80008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.412+0000 7f5e71ffb700 1 -- 172.21.15.164:0/1884373722 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5e84153880 con 0x7f5e8409e560 2020-11-20T11:50:44.555 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.551+0000 7f5e8afcc700 1 -- 172.21.15.164:0/1884373722 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e8405cf90 con 0x7f5e8409e560 2020-11-20T11:50:44.556 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.552+0000 7f5e71ffb700 1 -- 172.21.15.164:0/1884373722 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f5e7407ab60 con 0x7f5e8409e560 2020-11-20T11:50:44.556 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:44.557 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:39.612589+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:50:34.615204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:50:37.302647+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:44.558 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 -- 172.21.15.164:0/1884373722 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e5c080670 msgr2=0x7f5e5c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.558 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e5c080670 0x7f5e5c082b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5e8409db40 tx=0x7f5e80008040).stop 2020-11-20T11:50:44.558 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 -- 172.21.15.164:0/1884373722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 msgr2=0x7f5e84156450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.558 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 0x7f5e84156450 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5e7400c6e0 tx=0x7f5e740028b0).stop 2020-11-20T11:50:44.559 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 -- 172.21.15.164:0/1884373722 shutdown_connections 2020-11-20T11:50:44.559 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e5c080670 0x7f5e5c082b30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.559 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e8409e560 0x7f5e84156450 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.559 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e840bdfc0 0x7f5e84153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.559 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 --2- 172.21.15.164:0/1884373722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840bdbe0 0x7f5e840befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.560 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 -- 172.21.15.164:0/1884373722 >> 172.21.15.164:0/1884373722 conn(0x7f5e8407ffb0 msgr2=0x7f5e841503e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:44.560 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 -- 172.21.15.164:0/1884373722 shutdown_connections 2020-11-20T11:50:44.560 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.554+0000 7f5e8afcc700 1 -- 172.21.15.164:0/1884373722 wait complete. 2020-11-20T11:50:44.569 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-11-20T11:50:44.684 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.678+0000 7fa940b49700 1 Processor -- start 2020-11-20T11:50:44.684 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.678+0000 7fa940b49700 1 -- start start 2020-11-20T11:50:44.685 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.678+0000 7fa940b49700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa93c1544c0 0x7fa93c0c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.685 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa940b49700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93c0c3e50 con 0x7fa93c0c2460 2020-11-20T11:50:44.685 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa940b49700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93c151c60 con 0x7fa93c150640 2020-11-20T11:50:44.685 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa940b49700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93c0c28f0 con 0x7fa93c1544c0 2020-11-20T11:50:44.685 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa93affd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa93c1544c0 0x7fa93c0c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.686 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa93affd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa93c1544c0 0x7fa93c0c1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45476/0 (socket says 172.21.15.164:45476) 2020-11-20T11:50:44.686 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa93affd700 1 -- 172.21.15.164:0/4027380759 learned_addr learned my addr 172.21.15.164:0/4027380759 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:44.686 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa93affd700 1 -- 172.21.15.164:0/4027380759 >> v1:172.21.15.188:6789/0 conn(0x7fa93c150640 legacy=0x7fa93c0c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:44.686 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa93affd700 1 -- 172.21.15.164:0/4027380759 >> v1:172.21.15.36:6789/0 conn(0x7fa93c0c2460 legacy=0x7fa93c150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:44.687 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa93affd700 1 -- 172.21.15.164:0/4027380759 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c0c40e0 con 0x7fa93c1544c0 2020-11-20T11:50:44.687 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa93affd700 1 --2- 172.21.15.164:0/4027380759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa93c1544c0 0x7fa93c0c1f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa92c009a10 tx=0x7fa92c006ef0).ready entity=mon.1 client_cookie=7a67c101f9c39661 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.687 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa93a7fc700 1 -- 172.21.15.164:0/4027380759 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c00b870 con 0x7fa93c1544c0 2020-11-20T11:50:44.687 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa93a7fc700 1 -- 172.21.15.164:0/4027380759 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c000e90 con 0x7fa93c1544c0 2020-11-20T11:50:44.688 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.679+0000 7fa93a7fc700 1 -- 172.21.15.164:0/4027380759 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c00bbe0 con 0x7fa93c1544c0 2020-11-20T11:50:44.688 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.680+0000 7fa940b49700 1 -- 172.21.15.164:0/4027380759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa93c1544c0 msgr2=0x7fa93c0c1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.688 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.680+0000 7fa940b49700 1 --2- 172.21.15.164:0/4027380759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa93c1544c0 0x7fa93c0c1f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa92c009a10 tx=0x7fa92c006ef0).stop 2020-11-20T11:50:44.688 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.680+0000 7fa940b49700 1 -- 172.21.15.164:0/4027380759 shutdown_connections 2020-11-20T11:50:44.688 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.680+0000 7fa940b49700 1 --2- 172.21.15.164:0/4027380759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa93c1544c0 0x7fa93c0c1f70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.689 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.680+0000 7fa940b49700 1 -- 172.21.15.164:0/4027380759 >> 172.21.15.164:0/4027380759 conn(0x7fa93c07ffb0 msgr2=0x7fa93c0803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:44.689 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.680+0000 7fa940b49700 1 -- 172.21.15.164:0/4027380759 shutdown_connections 2020-11-20T11:50:44.689 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.680+0000 7fa940b49700 1 -- 172.21.15.164:0/4027380759 wait complete. 2020-11-20T11:50:44.692 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.681+0000 7fa940b49700 1 Processor -- start 2020-11-20T11:50:44.693 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.681+0000 7fa940b49700 1 -- start start 2020-11-20T11:50:44.693 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa940b49700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa93c0c2460 0x7fa93c164590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.693 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa940b49700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa93c150640 0x7fa93c0c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.694 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa940b49700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa93c1544c0 0x7fa93c112290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.694 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa940b49700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c154060 con 0x7fa93c0c2460 2020-11-20T11:50:44.694 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa940b49700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c164a80 con 0x7fa93c150640 2020-11-20T11:50:44.694 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa940b49700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c160700 con 0x7fa93c1544c0 2020-11-20T11:50:44.695 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93affd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa93c150640 0x7fa93c0c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.695 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93affd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa93c150640 0x7fa93c0c2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45484/0 (socket says 172.21.15.164:45484) 2020-11-20T11:50:44.695 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93affd700 1 -- 172.21.15.164:0/1491672038 learned_addr learned my addr 172.21.15.164:0/1491672038 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:44.696 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93b7fe700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa93c0c2460 0x7fa93c164590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.696 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93bfff700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa93c1544c0 0x7fa93c112290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.696 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93affd700 1 -- 172.21.15.164:0/1491672038 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa93c1544c0 msgr2=0x7fa93c112290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.696 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93affd700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa93c1544c0 0x7fa93c112290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.696 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93affd700 1 -- 172.21.15.164:0/1491672038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa93c0c2460 msgr2=0x7fa93c164590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.697 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93affd700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa93c0c2460 0x7fa93c164590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.697 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93affd700 1 -- 172.21.15.164:0/1491672038 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c1609a0 con 0x7fa93c150640 2020-11-20T11:50:44.697 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa93affd700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa93c150640 0x7fa93c0c2c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa92c011000 tx=0x7fa92c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.697 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa91b7fe700 1 -- 172.21.15.164:0/1491672038 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c011d30 con 0x7fa93c150640 2020-11-20T11:50:44.698 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa91b7fe700 1 -- 172.21.15.164:0/1491672038 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c011e90 con 0x7fa93c150640 2020-11-20T11:50:44.698 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa91b7fe700 1 -- 172.21.15.164:0/1491672038 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c01d680 con 0x7fa93c150640 2020-11-20T11:50:44.698 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.682+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93c160c40 con 0x7fa93c150640 2020-11-20T11:50:44.698 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.683+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93c161180 con 0x7fa93c150640 2020-11-20T11:50:44.699 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.683+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa93c161540 con 0x7fa93c150640 2020-11-20T11:50:44.699 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.684+0000 7fa91b7fe700 1 -- 172.21.15.164:0/1491672038 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa92c017040 con 0x7fa93c150640 2020-11-20T11:50:44.699 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.684+0000 7fa91b7fe700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa914080670 0x7fa914082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.699 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.684+0000 7fa91b7fe700 1 -- 172.21.15.164:0/1491672038 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa92c0a5480 con 0x7fa93c150640 2020-11-20T11:50:44.700 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.685+0000 7fa93b7fe700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa914080670 0x7fa914082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.700 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.685+0000 7fa91b7fe700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] conn(0x7fa9140893a0 0x7fa91408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.700 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.685+0000 7fa91b7fe700 1 -- 172.21.15.164:0/1491672038 --> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa91408be20 con 0x7fa9140893a0 2020-11-20T11:50:44.701 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.685+0000 7fa91b7fe700 1 -- 172.21.15.164:0/1491672038 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa92c0a57f0 con 0x7fa93c150640 2020-11-20T11:50:44.701 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.685+0000 7fa93bfff700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] conn(0x7fa9140893a0 0x7fa91408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.701 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.685+0000 7fa93b7fe700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa914080670 0x7fa914082b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa930003750 tx=0x7fa930007bb0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.702 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.685+0000 7fa93bfff700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] conn(0x7fa9140893a0 0x7fa91408b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.702 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.686+0000 7fa91b7fe700 1 -- 172.21.15.164:0/1491672038 <== osd.0 v2:172.21.15.164:6802/23229 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fa91408be20 con 0x7fa9140893a0 2020-11-20T11:50:44.704 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.699+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 --> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa93c0c3350 con 0x7fa9140893a0 2020-11-20T11:50:44.704 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa91b7fe700 1 -- 172.21.15.164:0/1491672038 <== osd.0 v2:172.21.15.164:6802/23229 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa93c0c3350 con 0x7fa9140893a0 2020-11-20T11:50:44.705 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] conn(0x7fa9140893a0 msgr2=0x7fa91408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.705 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa940b49700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] conn(0x7fa9140893a0 0x7fa91408b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.705 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa914080670 msgr2=0x7fa914082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.705 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa940b49700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa914080670 0x7fa914082b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa930003750 tx=0x7fa930007bb0).stop 2020-11-20T11:50:44.705 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa93c150640 msgr2=0x7fa93c0c2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.706 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa940b49700 1 --2- 172.21.15.164:0/1491672038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa93c150640 0x7fa93c0c2c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa92c011000 tx=0x7fa92c016000).stop 2020-11-20T11:50:44.706 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa93bfff700 1 -- 172.21.15.164:0/1491672038 reap_dead start 2020-11-20T11:50:44.706 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 shutdown_connections 2020-11-20T11:50:44.706 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 >> 172.21.15.164:0/1491672038 conn(0x7fa93c07ffb0 msgr2=0x7fa93c0c0740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:44.707 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 shutdown_connections 2020-11-20T11:50:44.707 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.700+0000 7fa940b49700 1 -- 172.21.15.164:0/1491672038 wait complete. 2020-11-20T11:50:44.715 INFO:teuthology.orchestra.run.smithi164.stdout:73014444037 2020-11-20T11:50:44.715 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-11-20T11:50:44.826 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.822+0000 7fefa6ada700 1 Processor -- start 2020-11-20T11:50:44.826 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.822+0000 7fefa6ada700 1 -- start start 2020-11-20T11:50:44.831 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fefa6ada700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fefa0066c30 0x7fefa00c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.831 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fefa6ada700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fefa0154780 0x7fefa0151a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.832 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fefa6ada700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa0155690 con 0x7fefa0066850 2020-11-20T11:50:44.832 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fefa6ada700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa0154eb0 con 0x7fefa0066c30 2020-11-20T11:50:44.832 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fefa6ada700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa0155150 con 0x7fefa0154780 2020-11-20T11:50:44.832 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9ffff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fefa0066c30 0x7fefa00c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.833 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9ffff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fefa0066c30 0x7fefa00c03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45492/0 (socket says 172.21.15.164:45492) 2020-11-20T11:50:44.833 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9ffff700 1 -- 172.21.15.164:0/1861743082 learned_addr learned my addr 172.21.15.164:0/1861743082 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:44.833 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9ffff700 1 -- 172.21.15.164:0/1861743082 >> v2:172.21.15.188:3300/0 conn(0x7fefa0154780 msgr2=0x7fefa0151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:44.833 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fefa5077700 1 --2- 172.21.15.164:0/1861743082 >> v2:172.21.15.188:3300/0 conn(0x7fefa0154780 0x7fefa0151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.834 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9ffff700 1 --2- 172.21.15.164:0/1861743082 >> v2:172.21.15.188:3300/0 conn(0x7fefa0154780 0x7fefa0151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.834 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9ffff700 1 -- 172.21.15.164:0/1861743082 >> v1:172.21.15.188:6789/0 conn(0x7fefa0066850 legacy=0x7fefa00c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:44.834 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9ffff700 1 -- 172.21.15.164:0/1861743082 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa01553f0 con 0x7fefa0066c30 2020-11-20T11:50:44.835 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fefa5077700 1 --2- 172.21.15.164:0/1861743082 >> v2:172.21.15.188:3300/0 conn(0x7fefa0154780 0x7fefa0151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:44.835 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9ffff700 1 --2- 172.21.15.164:0/1861743082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefa0066c30 0x7fefa00c03d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fefa00c2060 tx=0x7fef8c006ef0).ready entity=mon.1 client_cookie=8dfca68d5444ea97 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.835 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9f7fe700 1 -- 172.21.15.164:0/1861743082 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00b8b0 con 0x7fefa0066c30 2020-11-20T11:50:44.835 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9f7fe700 1 -- 172.21.15.164:0/1861743082 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c000e90 con 0x7fefa0066c30 2020-11-20T11:50:44.836 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.823+0000 7fef9f7fe700 1 -- 172.21.15.164:0/1861743082 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00bc20 con 0x7fefa0066c30 2020-11-20T11:50:44.836 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.824+0000 7fefa6ada700 1 -- 172.21.15.164:0/1861743082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefa0066c30 msgr2=0x7fefa00c03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.836 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.824+0000 7fefa6ada700 1 --2- 172.21.15.164:0/1861743082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefa0066c30 0x7fefa00c03d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fefa00c2060 tx=0x7fef8c006ef0).stop 2020-11-20T11:50:44.836 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.824+0000 7fefa6ada700 1 -- 172.21.15.164:0/1861743082 shutdown_connections 2020-11-20T11:50:44.837 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.824+0000 7fefa6ada700 1 --2- 172.21.15.164:0/1861743082 >> v2:172.21.15.188:3300/0 conn(0x7fefa0154780 0x7fefa0151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.837 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.824+0000 7fefa6ada700 1 --2- 172.21.15.164:0/1861743082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefa0066c30 0x7fefa00c03d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.837 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.824+0000 7fefa6ada700 1 -- 172.21.15.164:0/1861743082 >> 172.21.15.164:0/1861743082 conn(0x7fefa0060c80 msgr2=0x7fefa00c5660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:44.837 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.824+0000 7fefa6ada700 1 -- 172.21.15.164:0/1861743082 shutdown_connections 2020-11-20T11:50:44.838 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.824+0000 7fefa6ada700 1 -- 172.21.15.164:0/1861743082 wait complete. 2020-11-20T11:50:44.838 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.825+0000 7fefa6ada700 1 Processor -- start 2020-11-20T11:50:44.838 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.825+0000 7fefa6ada700 1 -- start start 2020-11-20T11:50:44.839 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fefa6ada700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefa0066850 0x7fefa01604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.839 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fefa6ada700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefa0066c30 0x7fefa008f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.839 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fefa6ada700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fefa0154780 0x7fefa0091f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.839 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fefa6ada700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa0090940 con 0x7fefa0154780 2020-11-20T11:50:44.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fefa6ada700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa0090160 con 0x7fefa0066c30 2020-11-20T11:50:44.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fefa6ada700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa0090400 con 0x7fefa0066850 2020-11-20T11:50:44.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fef9ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefa0066c30 0x7fefa008f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fef9ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefa0066c30 0x7fefa008f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45498/0 (socket says 172.21.15.164:45498) 2020-11-20T11:50:44.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fef9ffff700 1 -- 172.21.15.164:0/569456394 learned_addr learned my addr 172.21.15.164:0/569456394 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:44.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fefa4876700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefa0066850 0x7fefa01604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fefa5077700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fefa0154780 0x7fefa0091f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fef9ffff700 1 -- 172.21.15.164:0/569456394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefa0066850 msgr2=0x7fefa01604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fef9ffff700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefa0066850 0x7fefa01604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fef9ffff700 1 -- 172.21.15.164:0/569456394 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fefa0154780 msgr2=0x7fefa0091f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fef9ffff700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fefa0154780 0x7fefa0091f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fef9ffff700 1 -- 172.21.15.164:0/569456394 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa00906a0 con 0x7fefa0066c30 2020-11-20T11:50:44.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.826+0000 7fef9ffff700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefa0066c30 0x7fefa008f7f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fef8c011940 tx=0x7fef8c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.827+0000 7fef9cff9700 1 -- 172.21.15.164:0/569456394 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c011de0 con 0x7fefa0066c30 2020-11-20T11:50:44.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.827+0000 7fef9cff9700 1 -- 172.21.15.164:0/569456394 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c01d480 con 0x7fefa0066c30 2020-11-20T11:50:44.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.827+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa0152820 con 0x7fefa0066c30 2020-11-20T11:50:44.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.827+0000 7fef9cff9700 1 -- 172.21.15.164:0/569456394 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c01d800 con 0x7fefa0066c30 2020-11-20T11:50:44.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.827+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa009b4c0 con 0x7fefa0066c30 2020-11-20T11:50:44.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.828+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefa0080ba0 con 0x7fefa0066c30 2020-11-20T11:50:44.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.829+0000 7fef9cff9700 1 -- 172.21.15.164:0/569456394 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fef8c017070 con 0x7fefa0066c30 2020-11-20T11:50:44.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.829+0000 7fef9cff9700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef78080670 0x7fef78082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.847 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.829+0000 7fef9cff9700 1 -- 172.21.15.164:0/569456394 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fef8c0a5400 con 0x7fefa0066c30 2020-11-20T11:50:44.847 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.829+0000 7fefa4876700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef78080670 0x7fef78082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.847 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.829+0000 7fef9cff9700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] conn(0x7fef780893a0 0x7fef7808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.847 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.829+0000 7fef9cff9700 1 -- 172.21.15.164:0/569456394 --> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef7808be20 con 0x7fef780893a0 2020-11-20T11:50:44.848 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.829+0000 7fef9cff9700 1 -- 172.21.15.164:0/569456394 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef8c0a5770 con 0x7fefa0066c30 2020-11-20T11:50:44.848 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.829+0000 7fefa4876700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef78080670 0x7fef78082b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fef94003750 tx=0x7fef94007bb0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.848 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.830+0000 7fefa5077700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] conn(0x7fef780893a0 0x7fef7808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.848 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.830+0000 7fefa5077700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] conn(0x7fef780893a0 0x7fef7808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.849 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.831+0000 7fef9cff9700 1 -- 172.21.15.164:0/569456394 <== osd.1 v2:172.21.15.36:6800/23019 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fef7808be20 con 0x7fef780893a0 2020-11-20T11:50:44.851 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.845+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 --> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fefa0080ba0 con 0x7fef780893a0 2020-11-20T11:50:44.851 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.845+0000 7fef9cff9700 1 -- 172.21.15.164:0/569456394 <== osd.1 v2:172.21.15.36:6800/23019 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fefa0080ba0 con 0x7fef780893a0 2020-11-20T11:50:44.851 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.845+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 >> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] conn(0x7fef780893a0 msgr2=0x7fef7808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.851 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.845+0000 7fefa6ada700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] conn(0x7fef780893a0 0x7fef7808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.852 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.845+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef78080670 msgr2=0x7fef78082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.852 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.845+0000 7fefa6ada700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef78080670 0x7fef78082b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fef94003750 tx=0x7fef94007bb0).stop 2020-11-20T11:50:44.852 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.845+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefa0066c30 msgr2=0x7fefa008f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.852 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.845+0000 7fefa6ada700 1 --2- 172.21.15.164:0/569456394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefa0066c30 0x7fefa008f7f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fef8c011940 tx=0x7fef8c016000).stop 2020-11-20T11:50:44.853 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.845+0000 7fefa5077700 1 -- 172.21.15.164:0/569456394 reap_dead start 2020-11-20T11:50:44.853 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.846+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 shutdown_connections 2020-11-20T11:50:44.853 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.846+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 >> 172.21.15.164:0/569456394 conn(0x7fefa0060c80 msgr2=0x7fefa00c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:44.854 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.846+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 shutdown_connections 2020-11-20T11:50:44.854 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.846+0000 7fefa6ada700 1 -- 172.21.15.164:0/569456394 wait complete. 2020-11-20T11:50:44.860 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:44.861 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-11-20T11:50:44.970 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.966+0000 7fc2de7b0700 1 Processor -- start 2020-11-20T11:50:44.970 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.966+0000 7fc2de7b0700 1 -- start start 2020-11-20T11:50:44.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.967+0000 7fc2de7b0700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc2d80c4470 0x7fc2d80c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.967+0000 7fc2de7b0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc2d80bf680 0x7fc2d80bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.967+0000 7fc2de7b0700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d81555a0 con 0x7fc2d80bccf0 2020-11-20T11:50:44.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.967+0000 7fc2de7b0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d80c0000 con 0x7fc2d80bf680 2020-11-20T11:50:44.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.967+0000 7fc2de7b0700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d81517d0 con 0x7fc2d80c4470 2020-11-20T11:50:44.974 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.967+0000 7fc2dcd4d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc2d80bf680 0x7fc2d80bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.974 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.967+0000 7fc2d7fff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc2d80c4470 0x7fc2d80c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.974 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.967+0000 7fc2dcd4d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc2d80bf680 0x7fc2d80bfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.164:43938/0 (socket says 172.21.15.164:43938) 2020-11-20T11:50:44.974 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.967+0000 7fc2d77fe700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fc2d80bccf0 0x7fc2d80c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.164:40566/0 (socket says 172.21.15.164:40566) 2020-11-20T11:50:44.975 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.967+0000 7fc2dcd4d700 1 -- 172.21.15.164:0/3392738392 learned_addr learned my addr 172.21.15.164:0/3392738392 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:44.975 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2dcd4d700 1 -- 172.21.15.164:0/3392738392 >> v2:172.21.15.188:3300/0 conn(0x7fc2d80c4470 msgr2=0x7fc2d80c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:44.975 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2dcd4d700 1 --2- 172.21.15.164:0/3392738392 >> v2:172.21.15.188:3300/0 conn(0x7fc2d80c4470 0x7fc2d80c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.975 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2dcd4d700 1 -- 172.21.15.164:0/3392738392 >> v1:172.21.15.188:6789/0 conn(0x7fc2d80bccf0 legacy=0x7fc2d80c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.975 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2dcd4d700 1 -- 172.21.15.164:0/3392738392 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8151a70 con 0x7fc2d80bf680 2020-11-20T11:50:44.976 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2d6ffd700 1 -- 172.21.15.164:0/3392738392 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954083771 0 0) 0x7fc2d81555a0 con 0x7fc2d80bccf0 2020-11-20T11:50:44.976 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2d7fff700 1 --2- 172.21.15.164:0/3392738392 >> v2:172.21.15.188:3300/0 conn(0x7fc2d80c4470 0x7fc2d80c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:44.976 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2dcd4d700 1 --2- 172.21.15.164:0/3392738392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2d80bf680 0x7fc2d80bfb10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc2d8081020 tx=0x7fc2d00092d0).ready entity=mon.0 client_cookie=7481f45aad9cb169 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.976 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2d6ffd700 1 -- 172.21.15.164:0/3392738392 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d000bc80 con 0x7fc2d80bf680 2020-11-20T11:50:44.976 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2d6ffd700 1 -- 172.21.15.164:0/3392738392 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d000bde0 con 0x7fc2d80bf680 2020-11-20T11:50:44.977 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2d6ffd700 1 -- 172.21.15.164:0/3392738392 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0011610 con 0x7fc2d80bf680 2020-11-20T11:50:44.977 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3392738392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2d80bf680 msgr2=0x7fc2d80bfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.977 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2de7b0700 1 --2- 172.21.15.164:0/3392738392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2d80bf680 0x7fc2d80bfb10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc2d8081020 tx=0x7fc2d00092d0).stop 2020-11-20T11:50:44.977 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.968+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3392738392 shutdown_connections 2020-11-20T11:50:44.977 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.969+0000 7fc2de7b0700 1 --2- 172.21.15.164:0/3392738392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2d80bf680 0x7fc2d80bfb10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.978 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.969+0000 7fc2de7b0700 1 --2- 172.21.15.164:0/3392738392 >> v2:172.21.15.188:3300/0 conn(0x7fc2d80c4470 0x7fc2d80c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.978 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.969+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3392738392 >> 172.21.15.164:0/3392738392 conn(0x7fc2d80683b0 msgr2=0x7fc2d8061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:44.978 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.969+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3392738392 shutdown_connections 2020-11-20T11:50:44.978 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.969+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3392738392 wait complete. 2020-11-20T11:50:44.981 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.970+0000 7fc2de7b0700 1 Processor -- start 2020-11-20T11:50:44.981 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.970+0000 7fc2de7b0700 1 -- start start 2020-11-20T11:50:44.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.970+0000 7fc2de7b0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2d80bccf0 0x7fc2d8160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.970+0000 7fc2de7b0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2d80bf680 0x7fc2d8112230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.970+0000 7fc2de7b0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2d80c4470 0x7fc2d814ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2de7b0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8154280 con 0x7fc2d80bf680 2020-11-20T11:50:44.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2de7b0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8154520 con 0x7fc2d80c4470 2020-11-20T11:50:44.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2de7b0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d81547c0 con 0x7fc2d80bccf0 2020-11-20T11:50:44.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2dcd4d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2d80c4470 0x7fc2d814ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2dcd4d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2d80c4470 0x7fc2d814ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45516/0 (socket says 172.21.15.164:45516) 2020-11-20T11:50:44.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2dcd4d700 1 -- 172.21.15.164:0/3315291654 learned_addr learned my addr 172.21.15.164:0/3315291654 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:44.984 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2d7fff700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2d80bccf0 0x7fc2d8160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.984 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2d77fe700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2d80bf680 0x7fc2d8112230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.984 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2dcd4d700 1 -- 172.21.15.164:0/3315291654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2d80bccf0 msgr2=0x7fc2d8160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.984 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2dcd4d700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2d80bccf0 0x7fc2d8160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.984 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2dcd4d700 1 -- 172.21.15.164:0/3315291654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2d80bf680 msgr2=0x7fc2d8112230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.985 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2dcd4d700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2d80bf680 0x7fc2d8112230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.985 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2dcd4d700 1 -- 172.21.15.164:0/3315291654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8154a60 con 0x7fc2d80c4470 2020-11-20T11:50:44.985 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2d77fe700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2d80bf680 0x7fc2d8112230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:44.985 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2dcd4d700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2d80c4470 0x7fc2d814ba70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc2d0009130 tx=0x7fc2d0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.986 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2b7fff700 1 -- 172.21.15.164:0/3315291654 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d001b6b0 con 0x7fc2d80c4470 2020-11-20T11:50:44.986 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2b7fff700 1 -- 172.21.15.164:0/3315291654 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d001b810 con 0x7fc2d80c4470 2020-11-20T11:50:44.986 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d8154d00 con 0x7fc2d80c4470 2020-11-20T11:50:44.986 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2b7fff700 1 -- 172.21.15.164:0/3315291654 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d001bb90 con 0x7fc2d80c4470 2020-11-20T11:50:44.986 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.971+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d8112960 con 0x7fc2d80c4470 2020-11-20T11:50:44.987 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.972+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2d80c0fe0 con 0x7fc2d80c4470 2020-11-20T11:50:44.987 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.973+0000 7fc2b7fff700 1 -- 172.21.15.164:0/3315291654 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc2d0017070 con 0x7fc2d80c4470 2020-11-20T11:50:44.987 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.973+0000 7fc2b7fff700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc2b0080670 0x7fc2b0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.987 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.973+0000 7fc2b7fff700 1 -- 172.21.15.164:0/3315291654 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc2d00a55f0 con 0x7fc2d80c4470 2020-11-20T11:50:44.987 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.973+0000 7fc2d7fff700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc2b0080670 0x7fc2b0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.988 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.973+0000 7fc2b7fff700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] conn(0x7fc2b0089420 0x7fc2b008b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:44.988 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.973+0000 7fc2b7fff700 1 -- 172.21.15.164:0/3315291654 --> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2b008bea0 con 0x7fc2b0089420 2020-11-20T11:50:44.988 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.973+0000 7fc2b7fff700 1 -- 172.21.15.164:0/3315291654 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2d00a5920 con 0x7fc2d80c4470 2020-11-20T11:50:44.988 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.974+0000 7fc2d7fff700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc2b0080670 0x7fc2b0082b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc2c8006fd0 tx=0x7fc2c8006e30).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.988 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.974+0000 7fc2d77fe700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] conn(0x7fc2b0089420 0x7fc2b008b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:44.989 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.974+0000 7fc2d77fe700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] conn(0x7fc2b0089420 0x7fc2b008b840 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:44.989 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.975+0000 7fc2b7fff700 1 -- 172.21.15.164:0/3315291654 <== osd.2 v2:172.21.15.188:6800/23468 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fc2b008bea0 con 0x7fc2b0089420 2020-11-20T11:50:44.992 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.989+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 --> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc2d814c220 con 0x7fc2b0089420 2020-11-20T11:50:44.994 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.989+0000 7fc2b7fff700 1 -- 172.21.15.164:0/3315291654 <== osd.2 v2:172.21.15.188:6800/23468 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc2d814c220 con 0x7fc2b0089420 2020-11-20T11:50:44.994 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 >> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] conn(0x7fc2b0089420 msgr2=0x7fc2b008b840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.994 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2de7b0700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] conn(0x7fc2b0089420 0x7fc2b008b840 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:44.994 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc2b0080670 msgr2=0x7fc2b0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.995 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2de7b0700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc2b0080670 0x7fc2b0082b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc2c8006fd0 tx=0x7fc2c8006e30).stop 2020-11-20T11:50:44.995 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2d80c4470 msgr2=0x7fc2d814ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:44.995 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2de7b0700 1 --2- 172.21.15.164:0/3315291654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2d80c4470 0x7fc2d814ba70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc2d0009130 tx=0x7fc2d0016000).stop 2020-11-20T11:50:44.995 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2dcd4d700 1 -- 172.21.15.164:0/3315291654 reap_dead start 2020-11-20T11:50:44.996 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 shutdown_connections 2020-11-20T11:50:44.996 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 >> 172.21.15.164:0/3315291654 conn(0x7fc2d80683b0 msgr2=0x7fc2d8061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:44.996 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 shutdown_connections 2020-11-20T11:50:44.996 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:44.990+0000 7fc2de7b0700 1 -- 172.21.15.164:0/3315291654 wait complete. 2020-11-20T11:50:45.004 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:45.005 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-11-20T11:50:45.126 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.120+0000 7f90c7276700 1 Processor -- start 2020-11-20T11:50:45.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.120+0000 7f90c7276700 1 -- start start 2020-11-20T11:50:45.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90c7276700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f90c00633d0 0x7f90c0060c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90c7276700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f90c0061110 0x7f90c0151370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90c7276700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c00beaf0 con 0x7f90c0062ff0 2020-11-20T11:50:45.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90c7276700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c00bed90 con 0x7f90c0061110 2020-11-20T11:50:45.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90c7276700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c00bf030 con 0x7f90c00633d0 2020-11-20T11:50:45.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90c5012700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f90c0062ff0 0x7f90c00bb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55262/0 (socket says 172.21.15.164:55262) 2020-11-20T11:50:45.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90c5012700 1 -- 172.21.15.164:0/134610746 learned_addr learned my addr 172.21.15.164:0/134610746 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:45.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90c4811700 1 --2- 172.21.15.164:0/134610746 >> v2:172.21.15.188:3300/0 conn(0x7f90c00633d0 0x7f90c0060c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90affff700 1 -- 172.21.15.164:0/134610746 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918159960 0 0) 0x7f90c00beaf0 con 0x7f90c0062ff0 2020-11-20T11:50:45.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90affff700 1 -- 172.21.15.164:0/134610746 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a8003280 con 0x7f90c0062ff0 2020-11-20T11:50:45.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.121+0000 7f90c5813700 1 --2- 172.21.15.164:0/134610746 >> v2:172.21.15.36:3300/0 conn(0x7f90c0061110 0x7f90c0151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90affff700 1 -- 172.21.15.164:0/134610746 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 992162317 0 0) 0x7f90a8003280 con 0x7f90c0062ff0 2020-11-20T11:50:45.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c4811700 1 -- 172.21.15.164:0/134610746 >> v2:172.21.15.36:3300/0 conn(0x7f90c0061110 msgr2=0x7f90c0151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:45.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c4811700 1 --2- 172.21.15.164:0/134610746 >> v2:172.21.15.36:3300/0 conn(0x7f90c0061110 0x7f90c0151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.130 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c4811700 1 -- 172.21.15.164:0/134610746 >> v1:172.21.15.164:6789/0 conn(0x7f90c0062ff0 legacy=0x7f90c00bb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.130 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c4811700 1 -- 172.21.15.164:0/134610746 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c00bf2d0 con 0x7f90c00633d0 2020-11-20T11:50:45.130 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c4811700 1 --2- 172.21.15.164:0/134610746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90c00633d0 0x7f90c0060c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f90c00be590 tx=0x7f90bc006e30).ready entity=mon.2 client_cookie=1715f9fbeb46902d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90affff700 1 -- 172.21.15.164:0/134610746 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0001520 con 0x7f90c00633d0 2020-11-20T11:50:45.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90affff700 1 -- 172.21.15.164:0/134610746 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc000e90 con 0x7f90c00633d0 2020-11-20T11:50:45.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90affff700 1 -- 172.21.15.164:0/134610746 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc011610 con 0x7f90c00633d0 2020-11-20T11:50:45.131 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c7276700 1 -- 172.21.15.164:0/134610746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90c00633d0 msgr2=0x7f90c0060c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c7276700 1 --2- 172.21.15.164:0/134610746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90c00633d0 0x7f90c0060c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f90c00be590 tx=0x7f90bc006e30).stop 2020-11-20T11:50:45.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c7276700 1 -- 172.21.15.164:0/134610746 shutdown_connections 2020-11-20T11:50:45.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c7276700 1 --2- 172.21.15.164:0/134610746 >> v2:172.21.15.36:3300/0 conn(0x7f90c0061110 0x7f90c0151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c7276700 1 --2- 172.21.15.164:0/134610746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90c00633d0 0x7f90c0060c20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.132 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c7276700 1 -- 172.21.15.164:0/134610746 >> 172.21.15.164:0/134610746 conn(0x7f90c00c3e10 msgr2=0x7f90c00c4220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.133 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c7276700 1 -- 172.21.15.164:0/134610746 shutdown_connections 2020-11-20T11:50:45.133 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.122+0000 7f90c7276700 1 -- 172.21.15.164:0/134610746 wait complete. 2020-11-20T11:50:45.136 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.123+0000 7f90c7276700 1 Processor -- start 2020-11-20T11:50:45.136 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.123+0000 7f90c7276700 1 -- start start 2020-11-20T11:50:45.136 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.124+0000 7f90c7276700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c0061110 0x7f90c0155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.136 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.124+0000 7f90c7276700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90c0062ff0 0x7f90c0152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.137 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.124+0000 7f90c7276700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c00633d0 0x7f90c0164480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.137 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.124+0000 7f90c7276700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c014c4c0 con 0x7f90c0061110 2020-11-20T11:50:45.137 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.124+0000 7f90c7276700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c0154210 con 0x7f90c00633d0 2020-11-20T11:50:45.137 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.124+0000 7f90c7276700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c01544b0 con 0x7f90c0062ff0 2020-11-20T11:50:45.137 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.124+0000 7f90c5813700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c00633d0 0x7f90c0164480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.138 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.124+0000 7f90c5813700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c00633d0 0x7f90c0164480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45532/0 (socket says 172.21.15.164:45532) 2020-11-20T11:50:45.138 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.124+0000 7f90c5813700 1 -- 172.21.15.164:0/1025436482 learned_addr learned my addr 172.21.15.164:0/1025436482 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:45.138 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90c4811700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90c0062ff0 0x7f90c0152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.138 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90c5012700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c0061110 0x7f90c0155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.138 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90c5813700 1 -- 172.21.15.164:0/1025436482 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90c0062ff0 msgr2=0x7f90c0152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.139 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90c5813700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90c0062ff0 0x7f90c0152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.139 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90c5813700 1 -- 172.21.15.164:0/1025436482 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c0061110 msgr2=0x7f90c0155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.139 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90c5813700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c0061110 0x7f90c0155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.139 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90c5813700 1 -- 172.21.15.164:0/1025436482 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0154750 con 0x7f90c00633d0 2020-11-20T11:50:45.139 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90c5813700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c00633d0 0x7f90c0164480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f90b800ef50 tx=0x7f90b8009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.140 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90ad7fa700 1 -- 172.21.15.164:0/1025436482 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800cd20 con 0x7f90c00633d0 2020-11-20T11:50:45.140 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90ad7fa700 1 -- 172.21.15.164:0/1025436482 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b800ce80 con 0x7f90c00633d0 2020-11-20T11:50:45.140 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c0163d40 con 0x7f90c00633d0 2020-11-20T11:50:45.140 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90ad7fa700 1 -- 172.21.15.164:0/1025436482 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8012620 con 0x7f90c00633d0 2020-11-20T11:50:45.141 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.125+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c0152c20 con 0x7f90c00633d0 2020-11-20T11:50:45.141 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.126+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90c0154950 con 0x7f90c00633d0 2020-11-20T11:50:45.141 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.127+0000 7f90ad7fa700 1 -- 172.21.15.164:0/1025436482 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f90b8022070 con 0x7f90c00633d0 2020-11-20T11:50:45.141 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.127+0000 7f90ad7fa700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f9098080670 0x7f9098082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.127+0000 7f90ad7fa700 1 -- 172.21.15.164:0/1025436482 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f90b80a3920 con 0x7f90c00633d0 2020-11-20T11:50:45.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.127+0000 7f90c5012700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f9098080670 0x7f9098082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.127+0000 7f90ad7fa700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] conn(0x7f90980893a0 0x7f909808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.127+0000 7f90ad7fa700 1 -- 172.21.15.164:0/1025436482 --> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f909808be20 con 0x7f90980893a0 2020-11-20T11:50:45.142 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.127+0000 7f90ad7fa700 1 -- 172.21.15.164:0/1025436482 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90b80a3c90 con 0x7f90c00633d0 2020-11-20T11:50:45.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.127+0000 7f90c4811700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] conn(0x7f90980893a0 0x7f909808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.127+0000 7f90c5012700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f9098080670 0x7f9098082b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f90b0001ed0 tx=0x7f90b0001d70).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.128+0000 7f90c4811700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] conn(0x7f90980893a0 0x7f909808b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.143 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.128+0000 7f90ad7fa700 1 -- 172.21.15.164:0/1025436482 <== osd.3 v2:172.21.15.164:6810/23230 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f909808be20 con 0x7f90980893a0 2020-11-20T11:50:45.146 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.142+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 --> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90c01641a0 con 0x7f90980893a0 2020-11-20T11:50:45.147 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.142+0000 7f90ad7fa700 1 -- 172.21.15.164:0/1025436482 <== osd.3 v2:172.21.15.164:6810/23230 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f90c01641a0 con 0x7f90980893a0 2020-11-20T11:50:45.147 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] conn(0x7f90980893a0 msgr2=0x7f909808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.147 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c7276700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] conn(0x7f90980893a0 0x7f909808b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f9098080670 msgr2=0x7f9098082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c7276700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f9098080670 0x7f9098082b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f90b0001ed0 tx=0x7f90b0001d70).stop 2020-11-20T11:50:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c00633d0 msgr2=0x7f90c0164480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c7276700 1 --2- 172.21.15.164:0/1025436482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c00633d0 0x7f90c0164480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f90b800ef50 tx=0x7f90b8009220).stop 2020-11-20T11:50:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c5813700 1 -- 172.21.15.164:0/1025436482 reap_dead start 2020-11-20T11:50:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 shutdown_connections 2020-11-20T11:50:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 >> 172.21.15.164:0/1025436482 conn(0x7f90c00c3e10 msgr2=0x7f90c014e510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 shutdown_connections 2020-11-20T11:50:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.143+0000 7f90c7276700 1 -- 172.21.15.164:0/1025436482 wait complete. 2020-11-20T11:50:45.157 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:45.158 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2020-11-20T11:50:45.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.272+0000 7f108b3b1700 1 Processor -- start 2020-11-20T11:50:45.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.272+0000 7f108b3b1700 1 -- start start 2020-11-20T11:50:45.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108b3b1700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10840c4470 0x7f10840c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108b3b1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f10840bccf0 0x7f10840c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108b3b1700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f10840c10e0 0x7f10840bf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108b3b1700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10841555a0 con 0x7f10840bccf0 2020-11-20T11:50:45.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108b3b1700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10841517d0 con 0x7f10840c4470 2020-11-20T11:50:45.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108b3b1700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1084151a70 con 0x7f10840c10e0 2020-11-20T11:50:45.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108914d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10840c4470 0x7f10840c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108914d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10840c4470 0x7f10840c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45538/0 (socket says 172.21.15.164:45538) 2020-11-20T11:50:45.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108914d700 1 -- 172.21.15.164:0/2352705416 learned_addr learned my addr 172.21.15.164:0/2352705416 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:45.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108894c700 1 --2- 172.21.15.164:0/2352705416 >> v2:172.21.15.36:3300/0 conn(0x7f10840bccf0 0x7f10840c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108994e700 1 --2- 172.21.15.164:0/2352705416 >> v2:172.21.15.188:3300/0 conn(0x7f10840c10e0 0x7f10840bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108914d700 1 -- 172.21.15.164:0/2352705416 >> v2:172.21.15.188:3300/0 conn(0x7f10840c10e0 msgr2=0x7f10840bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:45.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108914d700 1 --2- 172.21.15.164:0/2352705416 >> v2:172.21.15.188:3300/0 conn(0x7f10840c10e0 0x7f10840bf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108914d700 1 -- 172.21.15.164:0/2352705416 >> v2:172.21.15.36:3300/0 conn(0x7f10840bccf0 msgr2=0x7f10840c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:45.282 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108914d700 1 --2- 172.21.15.164:0/2352705416 >> v2:172.21.15.36:3300/0 conn(0x7f10840bccf0 0x7f10840c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.283 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108914d700 1 -- 172.21.15.164:0/2352705416 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084151d10 con 0x7f10840c4470 2020-11-20T11:50:45.283 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.273+0000 7f108914d700 1 --2- 172.21.15.164:0/2352705416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10840c4470 0x7f10840c4850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f1084081020 tx=0x7f1080006ef0).ready entity=mon.1 client_cookie=be3137bc29c26245 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.283 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f1073fff700 1 -- 172.21.15.164:0/2352705416 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000b8c0 con 0x7f10840c4470 2020-11-20T11:50:45.284 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f1073fff700 1 -- 172.21.15.164:0/2352705416 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1080000e90 con 0x7f10840c4470 2020-11-20T11:50:45.284 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f1073fff700 1 -- 172.21.15.164:0/2352705416 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000bc30 con 0x7f10840c4470 2020-11-20T11:50:45.284 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f108b3b1700 1 -- 172.21.15.164:0/2352705416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10840c4470 msgr2=0x7f10840c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.285 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f108b3b1700 1 --2- 172.21.15.164:0/2352705416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10840c4470 0x7f10840c4850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f1084081020 tx=0x7f1080006ef0).stop 2020-11-20T11:50:45.285 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f108b3b1700 1 -- 172.21.15.164:0/2352705416 shutdown_connections 2020-11-20T11:50:45.285 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f108b3b1700 1 --2- 172.21.15.164:0/2352705416 >> v2:172.21.15.188:3300/0 conn(0x7f10840c10e0 0x7f10840bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f108b3b1700 1 --2- 172.21.15.164:0/2352705416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10840c4470 0x7f10840c4850 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.286 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f108b3b1700 1 --2- 172.21.15.164:0/2352705416 >> v2:172.21.15.36:3300/0 conn(0x7f10840bccf0 0x7f10840c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.287 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f108b3b1700 1 -- 172.21.15.164:0/2352705416 >> 172.21.15.164:0/2352705416 conn(0x7f10840683b0 msgr2=0x7f1084061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.287 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f108b3b1700 1 -- 172.21.15.164:0/2352705416 shutdown_connections 2020-11-20T11:50:45.287 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.274+0000 7f108b3b1700 1 -- 172.21.15.164:0/2352705416 wait complete. 2020-11-20T11:50:45.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.275+0000 7f108b3b1700 1 Processor -- start 2020-11-20T11:50:45.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.275+0000 7f108b3b1700 1 -- start start 2020-11-20T11:50:45.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108b3b1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10840bccf0 0x7f1084156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108b3b1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10840c10e0 0x7f1084160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.295 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108b3b1700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10840c4470 0x7f1084160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.295 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108b3b1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1084163a90 con 0x7f10840c10e0 2020-11-20T11:50:45.296 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108b3b1700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1084164940 con 0x7f10840bccf0 2020-11-20T11:50:45.296 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108b3b1700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10841612e0 con 0x7f10840c4470 2020-11-20T11:50:45.296 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108914d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10840bccf0 0x7f1084156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.297 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108914d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10840bccf0 0x7f1084156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45544/0 (socket says 172.21.15.164:45544) 2020-11-20T11:50:45.297 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108914d700 1 -- 172.21.15.164:0/2809349226 learned_addr learned my addr 172.21.15.164:0/2809349226 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:45.298 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108894c700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10840c10e0 0x7f1084160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.298 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108994e700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10840c4470 0x7f1084160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108914d700 1 -- 172.21.15.164:0/2809349226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10840c4470 msgr2=0x7f1084160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108914d700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10840c4470 0x7f1084160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108914d700 1 -- 172.21.15.164:0/2809349226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10840c10e0 msgr2=0x7f1084160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108914d700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10840c10e0 0x7f1084160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.276+0000 7f108914d700 1 -- 172.21.15.164:0/2809349226 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084163cc0 con 0x7f10840bccf0 2020-11-20T11:50:45.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.277+0000 7f108914d700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10840bccf0 0x7f1084156d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f10840c51c0 tx=0x7f1080016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.277+0000 7f10717fa700 1 -- 172.21.15.164:0/2809349226 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080011ea0 con 0x7f10840bccf0 2020-11-20T11:50:45.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.277+0000 7f10717fa700 1 -- 172.21.15.164:0/2809349226 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108001d480 con 0x7f10840bccf0 2020-11-20T11:50:45.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.277+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1084163f60 con 0x7f10840bccf0 2020-11-20T11:50:45.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.277+0000 7f10717fa700 1 -- 172.21.15.164:0/2809349226 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108001d820 con 0x7f10840bccf0 2020-11-20T11:50:45.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.277+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10841644a0 con 0x7f10840bccf0 2020-11-20T11:50:45.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.277+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1084069b70 con 0x7f10840bccf0 2020-11-20T11:50:45.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.278+0000 7f10717fa700 1 -- 172.21.15.164:0/2809349226 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1080017070 con 0x7f10840bccf0 2020-11-20T11:50:45.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.279+0000 7f10717fa700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f105c080670 0x7f105c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.279+0000 7f10717fa700 1 -- 172.21.15.164:0/2809349226 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f10800a5340 con 0x7f10840bccf0 2020-11-20T11:50:45.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.279+0000 7f108894c700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f105c080670 0x7f105c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.279+0000 7f10717fa700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] conn(0x7f105c0893a0 0x7f105c08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.279+0000 7f10717fa700 1 -- 172.21.15.164:0/2809349226 --> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f105c08be20 con 0x7f105c0893a0 2020-11-20T11:50:45.306 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.279+0000 7f10717fa700 1 -- 172.21.15.164:0/2809349226 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10800a56b0 con 0x7f10840bccf0 2020-11-20T11:50:45.306 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.279+0000 7f108894c700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f105c080670 0x7f105c082b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f108414fac0 tx=0x7f1074008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.307 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.279+0000 7f108994e700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] conn(0x7f105c0893a0 0x7f105c08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.307 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.280+0000 7f108994e700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] conn(0x7f105c0893a0 0x7f105c08b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.307 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.281+0000 7f10717fa700 1 -- 172.21.15.164:0/2809349226 <== osd.4 v2:172.21.15.36:6824/23020 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f105c08be20 con 0x7f105c0893a0 2020-11-20T11:50:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.294+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 --> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f10840bd940 con 0x7f105c0893a0 2020-11-20T11:50:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f10717fa700 1 -- 172.21.15.164:0/2809349226 <== osd.4 v2:172.21.15.36:6824/23020 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f10840bd940 con 0x7f105c0893a0 2020-11-20T11:50:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 >> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] conn(0x7f105c0893a0 msgr2=0x7f105c08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108b3b1700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] conn(0x7f105c0893a0 0x7f105c08b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f105c080670 msgr2=0x7f105c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.313 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108b3b1700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f105c080670 0x7f105c082b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f108414fac0 tx=0x7f1074008040).stop 2020-11-20T11:50:45.313 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10840bccf0 msgr2=0x7f1084156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108b3b1700 1 --2- 172.21.15.164:0/2809349226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10840bccf0 0x7f1084156d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f10840c51c0 tx=0x7f1080016000).stop 2020-11-20T11:50:45.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108994e700 1 -- 172.21.15.164:0/2809349226 reap_dead start 2020-11-20T11:50:45.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 shutdown_connections 2020-11-20T11:50:45.315 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 >> 172.21.15.164:0/2809349226 conn(0x7f10840683b0 msgr2=0x7f10840bdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.315 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 shutdown_connections 2020-11-20T11:50:45.316 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.296+0000 7f108b3b1700 1 -- 172.21.15.164:0/2809349226 wait complete. 2020-11-20T11:50:45.317 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:45.317 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2020-11-20T11:50:45.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.428+0000 7f24d322e700 1 Processor -- start 2020-11-20T11:50:45.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.428+0000 7f24d322e700 1 -- start start 2020-11-20T11:50:45.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.429+0000 7f24d322e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f24cc0c4470 0x7f24cc0c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.429+0000 7f24d322e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f24cc0bccf0 0x7f24cc0c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.429+0000 7f24d322e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24cc1555a0 con 0x7f24cc0c10e0 2020-11-20T11:50:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.429+0000 7f24d322e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc1517d0 con 0x7f24cc0c4470 2020-11-20T11:50:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.429+0000 7f24d322e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc151a70 con 0x7f24cc0bccf0 2020-11-20T11:50:45.437 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.429+0000 7f24cbfff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f24cc0bccf0 0x7f24cc0c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.437 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.429+0000 7f24d17cb700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f24cc0c10e0 0x7f24cc0bf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55296/0 (socket says 172.21.15.164:55296) 2020-11-20T11:50:45.437 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.429+0000 7f24d17cb700 1 -- 172.21.15.164:0/3622710702 learned_addr learned my addr 172.21.15.164:0/3622710702 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:45.437 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.429+0000 7f24cbfff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f24cc0bccf0 0x7f24cc0c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45558/0 (socket says 172.21.15.164:45558) 2020-11-20T11:50:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24d0fca700 1 --2- 172.21.15.164:0/3622710702 >> v2:172.21.15.36:3300/0 conn(0x7f24cc0c4470 0x7f24cc0c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24cbfff700 1 -- 172.21.15.164:0/3622710702 >> v2:172.21.15.36:3300/0 conn(0x7f24cc0c4470 msgr2=0x7f24cc0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24cbfff700 1 --2- 172.21.15.164:0/3622710702 >> v2:172.21.15.36:3300/0 conn(0x7f24cc0c4470 0x7f24cc0c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24cbfff700 1 -- 172.21.15.164:0/3622710702 >> v1:172.21.15.164:6789/0 conn(0x7f24cc0c10e0 legacy=0x7f24cc0bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24cbfff700 1 -- 172.21.15.164:0/3622710702 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc151d10 con 0x7f24cc0bccf0 2020-11-20T11:50:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24cb7fe700 1 -- 172.21.15.164:0/3622710702 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676111961 0 0) 0x7f24cc1555a0 con 0x7f24cc0c10e0 2020-11-20T11:50:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24cbfff700 1 --2- 172.21.15.164:0/3622710702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24cc0bccf0 0x7f24cc0c0bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f24cc0c4d40 tx=0x7f24b8006e30).ready entity=mon.1 client_cookie=651e2f64acfbd084 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24cb7fe700 1 -- 172.21.15.164:0/3622710702 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8009840 con 0x7f24cc0bccf0 2020-11-20T11:50:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24cb7fe700 1 -- 172.21.15.164:0/3622710702 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8000e90 con 0x7f24cc0bccf0 2020-11-20T11:50:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24cb7fe700 1 -- 172.21.15.164:0/3622710702 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8009bb0 con 0x7f24cc0bccf0 2020-11-20T11:50:45.440 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24d322e700 1 -- 172.21.15.164:0/3622710702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24cc0bccf0 msgr2=0x7f24cc0c0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.440 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24d322e700 1 --2- 172.21.15.164:0/3622710702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24cc0bccf0 0x7f24cc0c0bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f24cc0c4d40 tx=0x7f24b8006e30).stop 2020-11-20T11:50:45.440 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24d322e700 1 -- 172.21.15.164:0/3622710702 shutdown_connections 2020-11-20T11:50:45.440 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24d322e700 1 --2- 172.21.15.164:0/3622710702 >> v2:172.21.15.36:3300/0 conn(0x7f24cc0c4470 0x7f24cc0c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.440 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24d322e700 1 --2- 172.21.15.164:0/3622710702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24cc0bccf0 0x7f24cc0c0bf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.430+0000 7f24d322e700 1 -- 172.21.15.164:0/3622710702 >> 172.21.15.164:0/3622710702 conn(0x7f24cc0683b0 msgr2=0x7f24cc061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.431+0000 7f24d322e700 1 -- 172.21.15.164:0/3622710702 shutdown_connections 2020-11-20T11:50:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.431+0000 7f24d322e700 1 -- 172.21.15.164:0/3622710702 wait complete. 2020-11-20T11:50:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.432+0000 7f24d322e700 1 Processor -- start 2020-11-20T11:50:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.432+0000 7f24d322e700 1 -- start start 2020-11-20T11:50:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.432+0000 7f24d322e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24cc0bccf0 0x7f24cc153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.432+0000 7f24d322e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24cc0c10e0 0x7f24cc163b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.446 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.432+0000 7f24d322e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24cc0c4470 0x7f24cc152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.446 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.432+0000 7f24d322e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc154390 con 0x7f24cc0bccf0 2020-11-20T11:50:45.446 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.432+0000 7f24d322e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc154630 con 0x7f24cc0c4470 2020-11-20T11:50:45.447 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.432+0000 7f24d322e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc1548d0 con 0x7f24cc0c10e0 2020-11-20T11:50:45.447 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d17cb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24cc0c4470 0x7f24cc152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d17cb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24cc0c4470 0x7f24cc152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45564/0 (socket says 172.21.15.164:45564) 2020-11-20T11:50:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d17cb700 1 -- 172.21.15.164:0/484716971 learned_addr learned my addr 172.21.15.164:0/484716971 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d0fca700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24cc0bccf0 0x7f24cc153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.449 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24cbfff700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24cc0c10e0 0x7f24cc163b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.449 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d17cb700 1 -- 172.21.15.164:0/484716971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24cc0c10e0 msgr2=0x7f24cc163b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d17cb700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24cc0c10e0 0x7f24cc163b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d17cb700 1 -- 172.21.15.164:0/484716971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24cc0bccf0 msgr2=0x7f24cc153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d17cb700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24cc0bccf0 0x7f24cc153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d17cb700 1 -- 172.21.15.164:0/484716971 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc14c350 con 0x7f24cc0c4470 2020-11-20T11:50:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24cbfff700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24cc0c10e0 0x7f24cc163b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d17cb700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24cc0c4470 0x7f24cc152340 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f24c400cab0 tx=0x7f24c4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24c8ff9700 1 -- 172.21.15.164:0/484716971 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4005bc0 con 0x7f24cc0c4470 2020-11-20T11:50:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24c8ff9700 1 -- 172.21.15.164:0/484716971 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c4005d20 con 0x7f24cc0c4470 2020-11-20T11:50:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc14c5f0 con 0x7f24cc0c4470 2020-11-20T11:50:45.452 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24c8ff9700 1 -- 172.21.15.164:0/484716971 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4007360 con 0x7f24cc0c4470 2020-11-20T11:50:45.452 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.433+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc149a80 con 0x7f24cc0c4470 2020-11-20T11:50:45.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.434+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24cc149d30 con 0x7f24cc0c4470 2020-11-20T11:50:45.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.435+0000 7f24c8ff9700 1 -- 172.21.15.164:0/484716971 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f24c4010030 con 0x7f24cc0c4470 2020-11-20T11:50:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.435+0000 7f24c8ff9700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f24a4080670 0x7f24a4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.435+0000 7f24c8ff9700 1 -- 172.21.15.164:0/484716971 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f24c40a3240 con 0x7f24cc0c4470 2020-11-20T11:50:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.435+0000 7f24d0fca700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f24a4080670 0x7f24a4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.435+0000 7f24c8ff9700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] conn(0x7f24a40893a0 0x7f24a408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.435+0000 7f24c8ff9700 1 -- 172.21.15.164:0/484716971 --> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24a408be20 con 0x7f24a40893a0 2020-11-20T11:50:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.435+0000 7f24c8ff9700 1 -- 172.21.15.164:0/484716971 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24c40a35b0 con 0x7f24cc0c4470 2020-11-20T11:50:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.436+0000 7f24d0fca700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f24a4080670 0x7f24a4082b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f24c0006fd0 tx=0x7f24c0006e30).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.436+0000 7f24cbfff700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] conn(0x7f24a40893a0 0x7f24a408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.436+0000 7f24cbfff700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] conn(0x7f24a40893a0 0x7f24a408b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.437+0000 7f24c8ff9700 1 -- 172.21.15.164:0/484716971 <== osd.5 v2:172.21.15.188:6808/23469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f24a408be20 con 0x7f24a40893a0 2020-11-20T11:50:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.451+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 --> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f24cc0bd390 con 0x7f24a40893a0 2020-11-20T11:50:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.451+0000 7f24c8ff9700 1 -- 172.21.15.164:0/484716971 <== osd.5 v2:172.21.15.188:6808/23469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f24cc0bd390 con 0x7f24a40893a0 2020-11-20T11:50:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 >> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] conn(0x7f24a40893a0 msgr2=0x7f24a408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d322e700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] conn(0x7f24a40893a0 0x7f24a408b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.460 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f24a4080670 msgr2=0x7f24a4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.460 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d322e700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f24a4080670 0x7f24a4082b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f24c0006fd0 tx=0x7f24c0006e30).stop 2020-11-20T11:50:45.460 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24cc0c4470 msgr2=0x7f24cc152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.460 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d322e700 1 --2- 172.21.15.164:0/484716971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24cc0c4470 0x7f24cc152340 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f24c400cab0 tx=0x7f24c4007dc0).stop 2020-11-20T11:50:45.460 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d17cb700 1 -- 172.21.15.164:0/484716971 reap_dead start 2020-11-20T11:50:45.461 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 shutdown_connections 2020-11-20T11:50:45.461 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 >> 172.21.15.164:0/484716971 conn(0x7f24cc0683b0 msgr2=0x7f24cc14dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.461 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 shutdown_connections 2020-11-20T11:50:45.461 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.452+0000 7f24d322e700 1 -- 172.21.15.164:0/484716971 wait complete. 2020-11-20T11:50:45.466 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:45.467 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2020-11-20T11:50:45.583 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.579+0000 7f9d66e51700 1 Processor -- start 2020-11-20T11:50:45.583 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.579+0000 7f9d66e51700 1 -- start start 2020-11-20T11:50:45.586 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.580+0000 7f9d66e51700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d601555a0 con 0x7f9d600bfd90 2020-11-20T11:50:45.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.580+0000 7f9d66e51700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d601517d0 con 0x7f9d600c4470 2020-11-20T11:50:45.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.580+0000 7f9d66e51700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d60151a70 con 0x7f9d600bccf0 2020-11-20T11:50:45.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.580+0000 7f9d64bed700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f9d600c4470 0x7f9d600c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55310/0 (socket says 172.21.15.164:55310) 2020-11-20T11:50:45.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.580+0000 7f9d64bed700 1 -- 172.21.15.164:0/2822150777 learned_addr learned my addr 172.21.15.164:0/2822150777 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:45.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.580+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656429714 0 0) 0x7f9d601517d0 con 0x7f9d600c4470 2020-11-20T11:50:45.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.580+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d44003280 con 0x7f9d600c4470 2020-11-20T11:50:45.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2660431021 0 0) 0x7f9d44003280 con 0x7f9d600c4470 2020-11-20T11:50:45.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 >> v1:172.21.15.188:6789/0 conn(0x7f9d600bccf0 legacy=0x7f9d600bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 >> v1:172.21.15.36:6789/0 conn(0x7f9d600bfd90 legacy=0x7f9d6015ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60151d10 con 0x7f9d600c4470 2020-11-20T11:50:45.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7f9d54001520 con 0x7f9d600c4470 2020-11-20T11:50:45.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 >> v1:172.21.15.164:6789/0 conn(0x7f9d600c4470 legacy=0x7f9d600c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d440037a0 0x7f9d44003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d44004520 0x7f9d440049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d44004e90 0x7f9d4400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.590 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440042b0 con 0x7f9d44004e90 2020-11-20T11:50:45.590 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4400bc60 con 0x7f9d440037a0 2020-11-20T11:50:45.590 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4400bda0 con 0x7f9d44004520 2020-11-20T11:50:45.590 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d64bed700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d440037a0 0x7f9d44003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5ffff700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d44004520 0x7f9d440049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d653ee700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d44004e90 0x7f9d4400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d64bed700 1 -- 172.21.15.164:0/2822150777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d44004520 msgr2=0x7f9d440049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:45.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d64bed700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d44004520 0x7f9d440049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d64bed700 1 -- 172.21.15.164:0/2822150777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d44004e90 msgr2=0x7f9d4400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:45.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d64bed700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d44004e90 0x7f9d4400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d64bed700 1 -- 172.21.15.164:0/2822150777 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d44003280 con 0x7f9d440037a0 2020-11-20T11:50:45.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d653ee700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d44004e90 0x7f9d4400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:45.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d653ee700 1 -- 172.21.15.164:0/2822150777 reap_dead start 2020-11-20T11:50:45.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d64bed700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d440037a0 0x7f9d44003ba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f9d5400c440 tx=0x7f9d60151c00).ready entity=mon.1 client_cookie=cf58fc7e78f36c2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.593 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540070d0 con 0x7f9d440037a0 2020-11-20T11:50:45.593 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d54007230 con 0x7f9d440037a0 2020-11-20T11:50:45.593 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.581+0000 7f9d5f7fe700 1 -- 172.21.15.164:0/2822150777 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54005630 con 0x7f9d440037a0 2020-11-20T11:50:45.593 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.582+0000 7f9d66e51700 1 -- 172.21.15.164:0/2822150777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d440037a0 msgr2=0x7f9d44003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.593 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.582+0000 7f9d66e51700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d440037a0 0x7f9d44003ba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f9d5400c440 tx=0x7f9d60151c00).stop 2020-11-20T11:50:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.582+0000 7f9d66e51700 1 -- 172.21.15.164:0/2822150777 shutdown_connections 2020-11-20T11:50:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.582+0000 7f9d66e51700 1 --2- 172.21.15.164:0/2822150777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d440037a0 0x7f9d44003ba0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.582+0000 7f9d66e51700 1 -- 172.21.15.164:0/2822150777 >> 172.21.15.164:0/2822150777 conn(0x7f9d600683b0 msgr2=0x7f9d60061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.582+0000 7f9d66e51700 1 -- 172.21.15.164:0/2822150777 shutdown_connections 2020-11-20T11:50:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.582+0000 7f9d66e51700 1 -- 172.21.15.164:0/2822150777 wait complete. 2020-11-20T11:50:45.595 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.583+0000 7f9d66e51700 1 Processor -- start 2020-11-20T11:50:45.597 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.583+0000 7f9d66e51700 1 -- start start 2020-11-20T11:50:45.598 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d66e51700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d440037a0 0x7f9d600c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.598 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d66e51700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d600c2da0 0x7f9d60152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.598 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d66e51700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d601528f0 0x7f9d601533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.598 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d66e51700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60157600 con 0x7f9d440037a0 2020-11-20T11:50:45.598 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d66e51700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d601610c0 con 0x7f9d601528f0 2020-11-20T11:50:45.599 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d66e51700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d601577f0 con 0x7f9d600c2da0 2020-11-20T11:50:45.599 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d653ee700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d601528f0 0x7f9d601533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.599 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d653ee700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d601528f0 0x7f9d601533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45584/0 (socket says 172.21.15.164:45584) 2020-11-20T11:50:45.599 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d653ee700 1 -- 172.21.15.164:0/1870957345 learned_addr learned my addr 172.21.15.164:0/1870957345 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:45.599 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d5ffff700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d600c2da0 0x7f9d60152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.600 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d64bed700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d440037a0 0x7f9d600c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.600 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d653ee700 1 -- 172.21.15.164:0/1870957345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d600c2da0 msgr2=0x7f9d60152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.600 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d653ee700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d600c2da0 0x7f9d60152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.600 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d653ee700 1 -- 172.21.15.164:0/1870957345 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d440037a0 msgr2=0x7f9d600c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.600 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d653ee700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d440037a0 0x7f9d600c28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.601 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d653ee700 1 -- 172.21.15.164:0/1870957345 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60157a90 con 0x7f9d601528f0 2020-11-20T11:50:45.601 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d653ee700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d601528f0 0x7f9d601533f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9d600c5190 tx=0x7f9d58009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.601 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.584+0000 7f9d5cff9700 1 -- 172.21.15.164:0/1870957345 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5800c690 con 0x7f9d601528f0 2020-11-20T11:50:45.601 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.585+0000 7f9d5cff9700 1 -- 172.21.15.164:0/1870957345 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5800c7f0 con 0x7f9d601528f0 2020-11-20T11:50:45.601 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.585+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d60157d30 con 0x7f9d601528f0 2020-11-20T11:50:45.602 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.585+0000 7f9d5cff9700 1 -- 172.21.15.164:0/1870957345 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5800cb70 con 0x7f9d601528f0 2020-11-20T11:50:45.602 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.585+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d60158470 con 0x7f9d601528f0 2020-11-20T11:50:45.602 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.585+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d60069b70 con 0x7f9d601528f0 2020-11-20T11:50:45.602 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.586+0000 7f9d5cff9700 1 -- 172.21.15.164:0/1870957345 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9d5801b030 con 0x7f9d601528f0 2020-11-20T11:50:45.602 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.587+0000 7f9d5cff9700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f9d380806a0 0x7f9d38082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.603 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.587+0000 7f9d5cff9700 1 -- 172.21.15.164:0/1870957345 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f9d580a2fc0 con 0x7f9d601528f0 2020-11-20T11:50:45.603 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.587+0000 7f9d64bed700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f9d380806a0 0x7f9d38082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.603 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.587+0000 7f9d5cff9700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] conn(0x7f9d380893d0 0x7f9d3808b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.603 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.587+0000 7f9d5cff9700 1 -- 172.21.15.164:0/1870957345 --> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d3808be50 con 0x7f9d380893d0 2020-11-20T11:50:45.603 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.587+0000 7f9d5cff9700 1 -- 172.21.15.164:0/1870957345 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d580a32d0 con 0x7f9d601528f0 2020-11-20T11:50:45.604 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.587+0000 7f9d5ffff700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] conn(0x7f9d380893d0 0x7f9d3808b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.604 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.587+0000 7f9d64bed700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f9d380806a0 0x7f9d38082b60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f9d5400c440 tx=0x7f9d54015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.604 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.587+0000 7f9d5ffff700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] conn(0x7f9d380893d0 0x7f9d3808b7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.604 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.588+0000 7f9d5cff9700 1 -- 172.21.15.164:0/1870957345 <== osd.6 v2:172.21.15.164:6812/23231 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f9d3808be50 con 0x7f9d380893d0 2020-11-20T11:50:45.607 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.601+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 --> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d6005d590 con 0x7f9d380893d0 2020-11-20T11:50:45.608 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d5cff9700 1 -- 172.21.15.164:0/1870957345 <== osd.6 v2:172.21.15.164:6812/23231 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d6005d590 con 0x7f9d380893d0 2020-11-20T11:50:45.608 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] conn(0x7f9d380893d0 msgr2=0x7f9d3808b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.609 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d66e51700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] conn(0x7f9d380893d0 0x7f9d3808b7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.609 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f9d380806a0 msgr2=0x7f9d38082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.610 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d66e51700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f9d380806a0 0x7f9d38082b60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f9d5400c440 tx=0x7f9d54015000).stop 2020-11-20T11:50:45.610 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d601528f0 msgr2=0x7f9d601533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.610 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d66e51700 1 --2- 172.21.15.164:0/1870957345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d601528f0 0x7f9d601533f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9d600c5190 tx=0x7f9d58009040).stop 2020-11-20T11:50:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d653ee700 1 -- 172.21.15.164:0/1870957345 reap_dead start 2020-11-20T11:50:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 shutdown_connections 2020-11-20T11:50:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 >> 172.21.15.164:0/1870957345 conn(0x7f9d600683b0 msgr2=0x7f9d600bd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.612 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 shutdown_connections 2020-11-20T11:50:45.612 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.602+0000 7f9d66e51700 1 -- 172.21.15.164:0/1870957345 wait complete. 2020-11-20T11:50:45.617 INFO:teuthology.orchestra.run.smithi164.stdout:73014444037 2020-11-20T11:50:45.617 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2020-11-20T11:50:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.723+0000 7f1f42524700 1 Processor -- start 2020-11-20T11:50:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.723+0000 7f1f42524700 1 -- start start 2020-11-20T11:50:45.729 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.724+0000 7f1f42524700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1f3c0c2150 0x7f1f3c061f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.724+0000 7f1f42524700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c0625c0 con 0x7f1f3c066530 2020-11-20T11:50:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.724+0000 7f1f42524700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c151130 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.724+0000 7f1f42524700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c25b0 con 0x7f1f3c0c2150 2020-11-20T11:50:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.725+0000 7f1f40d21700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1f3c0c2150 0x7f1f3c061f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.725+0000 7f1f41522700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f1f3c0c1d70 0x7f1f3c0bbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.164:40648/0 (socket says 172.21.15.164:40648) 2020-11-20T11:50:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.725+0000 7f1f41522700 1 -- 172.21.15.164:0/176440182 learned_addr learned my addr 172.21.15.164:0/176440182 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.725+0000 7f1f40d21700 1 -- 172.21.15.164:0/176440182 >> v1:172.21.15.188:6789/0 conn(0x7f1f3c0c1d70 legacy=0x7f1f3c0bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.725+0000 7f1f40d21700 1 -- 172.21.15.164:0/176440182 >> v1:172.21.15.36:6789/0 conn(0x7f1f3c066530 legacy=0x7f1f3c14df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.725+0000 7f1f40d21700 1 -- 172.21.15.164:0/176440182 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c1513d0 con 0x7f1f3c0c2150 2020-11-20T11:50:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.725+0000 7f1f40d21700 1 --2- 172.21.15.164:0/176440182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f3c0c2150 0x7f1f3c061f00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1f2c006fd0 tx=0x7f1f2c006e30).ready entity=mon.2 client_cookie=39e20645e48c60e8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.725+0000 7f1f2bfff700 1 -- 172.21.15.164:0/176440182 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c009870 con 0x7f1f3c0c2150 2020-11-20T11:50:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.725+0000 7f1f2bfff700 1 -- 172.21.15.164:0/176440182 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c000e90 con 0x7f1f3c0c2150 2020-11-20T11:50:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.725+0000 7f1f2bfff700 1 -- 172.21.15.164:0/176440182 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c009be0 con 0x7f1f3c0c2150 2020-11-20T11:50:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.726+0000 7f1f42524700 1 -- 172.21.15.164:0/176440182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f3c0c2150 msgr2=0x7f1f3c061f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.726+0000 7f1f42524700 1 --2- 172.21.15.164:0/176440182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f3c0c2150 0x7f1f3c061f00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1f2c006fd0 tx=0x7f1f2c006e30).stop 2020-11-20T11:50:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.726+0000 7f1f42524700 1 -- 172.21.15.164:0/176440182 shutdown_connections 2020-11-20T11:50:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.726+0000 7f1f42524700 1 --2- 172.21.15.164:0/176440182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f3c0c2150 0x7f1f3c061f00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.726+0000 7f1f42524700 1 -- 172.21.15.164:0/176440182 >> 172.21.15.164:0/176440182 conn(0x7f1f3c0c5450 msgr2=0x7f1f3c0c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.726+0000 7f1f42524700 1 -- 172.21.15.164:0/176440182 shutdown_connections 2020-11-20T11:50:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.726+0000 7f1f42524700 1 -- 172.21.15.164:0/176440182 wait complete. 2020-11-20T11:50:45.737 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.727+0000 7f1f42524700 1 Processor -- start 2020-11-20T11:50:45.738 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.727+0000 7f1f42524700 1 -- start start 2020-11-20T11:50:45.738 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f42524700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f3c066530 0x7f1f3c066b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.739 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f42524700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3c0c1d70 0x7f1f3c160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.739 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f42524700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f3c0c2150 0x7f1f3c161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.739 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f42524700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c164030 con 0x7f1f3c0c2150 2020-11-20T11:50:45.740 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f42524700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c150980 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.740 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f42524700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c150c20 con 0x7f1f3c066530 2020-11-20T11:50:45.741 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f40d21700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3c0c1d70 0x7f1f3c160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.741 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f40d21700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3c0c1d70 0x7f1f3c160b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45600/0 (socket says 172.21.15.164:45600) 2020-11-20T11:50:45.741 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f40d21700 1 -- 172.21.15.164:0/122513221 learned_addr learned my addr 172.21.15.164:0/122513221 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:45.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f41522700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f3c066530 0x7f1f3c066b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f40d21700 1 -- 172.21.15.164:0/122513221 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f3c066530 msgr2=0x7f1f3c066b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f41d23700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f3c0c2150 0x7f1f3c161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f40d21700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f3c066530 0x7f1f3c066b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f40d21700 1 -- 172.21.15.164:0/122513221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f3c0c2150 msgr2=0x7f1f3c161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f40d21700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f3c0c2150 0x7f1f3c161040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f40d21700 1 -- 172.21.15.164:0/122513221 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c164260 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f40d21700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3c0c1d70 0x7f1f3c160b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1f2c009340 tx=0x7f1f2c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.745 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f297fa700 1 -- 172.21.15.164:0/122513221 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c01e460 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.745 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.728+0000 7f1f297fa700 1 -- 172.21.15.164:0/122513221 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c01e5c0 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.746 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.729+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c164500 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.746 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.729+0000 7f1f297fa700 1 -- 172.21.15.164:0/122513221 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c01e960 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.746 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.729+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c14bdd0 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.747 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.730+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f3c155120 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.747 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.730+0000 7f1f297fa700 1 -- 172.21.15.164:0/122513221 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1f2c025030 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.748 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.731+0000 7f1f297fa700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1f18080670 0x7f1f18082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.748 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.731+0000 7f1f297fa700 1 -- 172.21.15.164:0/122513221 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1f2c0a4630 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.748 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.731+0000 7f1f41522700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1f18080670 0x7f1f18082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.731+0000 7f1f297fa700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] conn(0x7f1f180893a0 0x7f1f1808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.731+0000 7f1f297fa700 1 -- 172.21.15.164:0/122513221 --> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f1808be20 con 0x7f1f180893a0 2020-11-20T11:50:45.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.731+0000 7f1f297fa700 1 -- 172.21.15.164:0/122513221 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f2c0a6c10 con 0x7f1f3c0c1d70 2020-11-20T11:50:45.750 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.731+0000 7f1f41522700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1f18080670 0x7f1f18082b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1f38001530 tx=0x7f1f38009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.750 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.731+0000 7f1f41d23700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] conn(0x7f1f180893a0 0x7f1f1808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.751 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.732+0000 7f1f41d23700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] conn(0x7f1f180893a0 0x7f1f1808b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.751 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.732+0000 7f1f297fa700 1 -- 172.21.15.164:0/122513221 <== osd.7 v2:172.21.15.36:6808/23021 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f1f1808be20 con 0x7f1f180893a0 2020-11-20T11:50:45.754 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.746+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 --> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f3c044fa0 con 0x7f1f180893a0 2020-11-20T11:50:45.754 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.747+0000 7f1f297fa700 1 -- 172.21.15.164:0/122513221 <== osd.7 v2:172.21.15.36:6808/23021 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1f3c044fa0 con 0x7f1f180893a0 2020-11-20T11:50:45.754 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 >> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] conn(0x7f1f180893a0 msgr2=0x7f1f1808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.755 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f42524700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] conn(0x7f1f180893a0 0x7f1f1808b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.755 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1f18080670 msgr2=0x7f1f18082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.755 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f42524700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1f18080670 0x7f1f18082b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1f38001530 tx=0x7f1f38009040).stop 2020-11-20T11:50:45.756 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3c0c1d70 msgr2=0x7f1f3c160b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.756 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f42524700 1 --2- 172.21.15.164:0/122513221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f3c0c1d70 0x7f1f3c160b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1f2c009340 tx=0x7f1f2c015000).stop 2020-11-20T11:50:45.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f41d23700 1 -- 172.21.15.164:0/122513221 reap_dead start 2020-11-20T11:50:45.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 shutdown_connections 2020-11-20T11:50:45.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 >> 172.21.15.164:0/122513221 conn(0x7f1f3c0c5450 msgr2=0x7f1f3c0c4680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 shutdown_connections 2020-11-20T11:50:45.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.748+0000 7f1f42524700 1 -- 172.21.15.164:0/122513221 wait complete. 2020-11-20T11:50:45.762 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:45.763 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2020-11-20T11:50:45.873 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.870+0000 7fc000fe4700 1 Processor -- start 2020-11-20T11:50:45.874 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.870+0000 7fc000fe4700 1 -- start start 2020-11-20T11:50:45.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fc000fe4700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbffc0c4470 0x7fbffc0c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fc000fe4700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbffc0bccf0 0x7fbffc0c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fc000fe4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbffc0c10e0 0x7fbffc0bf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fc000fe4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc1555a0 con 0x7fbffc0c10e0 2020-11-20T11:50:45.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fc000fe4700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc1517d0 con 0x7fbffc0c4470 2020-11-20T11:50:45.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fc000fe4700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc151a70 con 0x7fbffc0bccf0 2020-11-20T11:50:45.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbffa59c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbffc0c4470 0x7fbffc0c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbffa59c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbffc0c4470 0x7fbffc0c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45608/0 (socket says 172.21.15.164:45608) 2020-11-20T11:50:45.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbffa59c700 1 -- 172.21.15.164:0/3865258469 learned_addr learned my addr 172.21.15.164:0/3865258469 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:45.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbff3fff700 1 --2- 172.21.15.164:0/3865258469 >> v2:172.21.15.188:3300/0 conn(0x7fbffc0bccf0 0x7fbffc0c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbffa59c700 1 -- 172.21.15.164:0/3865258469 >> v2:172.21.15.188:3300/0 conn(0x7fbffc0bccf0 msgr2=0x7fbffc0c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:45.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbffa59c700 1 --2- 172.21.15.164:0/3865258469 >> v2:172.21.15.188:3300/0 conn(0x7fbffc0bccf0 0x7fbffc0c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbffa59c700 1 -- 172.21.15.164:0/3865258469 >> v2:172.21.15.36:3300/0 conn(0x7fbffc0c10e0 msgr2=0x7fbffc0bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:45.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbffa59c700 1 --2- 172.21.15.164:0/3865258469 >> v2:172.21.15.36:3300/0 conn(0x7fbffc0c10e0 0x7fbffc0bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:45.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbffa59c700 1 -- 172.21.15.164:0/3865258469 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc151d10 con 0x7fbffc0c4470 2020-11-20T11:50:45.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbffa59c700 1 --2- 172.21.15.164:0/3865258469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbffc0c4470 0x7fbffc0c4850 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fbffc081020 tx=0x7fbfec006ef0).ready entity=mon.1 client_cookie=20c19fe40cca88ce server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbff9d9b700 1 -- 172.21.15.164:0/3865258469 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00b8c0 con 0x7fbffc0c4470 2020-11-20T11:50:45.880 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbff9d9b700 1 -- 172.21.15.164:0/3865258469 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec000e90 con 0x7fbffc0c4470 2020-11-20T11:50:45.880 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.871+0000 7fbff9d9b700 1 -- 172.21.15.164:0/3865258469 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00bc30 con 0x7fbffc0c4470 2020-11-20T11:50:45.880 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.872+0000 7fc000fe4700 1 -- 172.21.15.164:0/3865258469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbffc0c4470 msgr2=0x7fbffc0c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.880 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.872+0000 7fc000fe4700 1 --2- 172.21.15.164:0/3865258469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbffc0c4470 0x7fbffc0c4850 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fbffc081020 tx=0x7fbfec006ef0).stop 2020-11-20T11:50:45.880 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.872+0000 7fc000fe4700 1 -- 172.21.15.164:0/3865258469 shutdown_connections 2020-11-20T11:50:45.881 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.872+0000 7fc000fe4700 1 --2- 172.21.15.164:0/3865258469 >> v2:172.21.15.36:3300/0 conn(0x7fbffc0c10e0 0x7fbffc0bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:45.881 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.872+0000 7fc000fe4700 1 --2- 172.21.15.164:0/3865258469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbffc0c4470 0x7fbffc0c4850 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.881 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.872+0000 7fc000fe4700 1 --2- 172.21.15.164:0/3865258469 >> v2:172.21.15.188:3300/0 conn(0x7fbffc0bccf0 0x7fbffc0c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.881 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.872+0000 7fc000fe4700 1 -- 172.21.15.164:0/3865258469 >> 172.21.15.164:0/3865258469 conn(0x7fbffc0683b0 msgr2=0x7fbffc061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.881 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.872+0000 7fc000fe4700 1 -- 172.21.15.164:0/3865258469 shutdown_connections 2020-11-20T11:50:45.882 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.872+0000 7fc000fe4700 1 -- 172.21.15.164:0/3865258469 wait complete. 2020-11-20T11:50:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.873+0000 7fc000fe4700 1 Processor -- start 2020-11-20T11:50:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.873+0000 7fc000fe4700 1 -- start start 2020-11-20T11:50:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fc000fe4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbffc0bccf0 0x7fbffc155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fc000fe4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbffc0c10e0 0x7fbffc164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fc000fe4700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbffc0c4470 0x7fbffc1404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fc000fe4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc164b70 con 0x7fbffc0bccf0 2020-11-20T11:50:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fc000fe4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc157280 con 0x7fbffc0c10e0 2020-11-20T11:50:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fc000fe4700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc157520 con 0x7fbffc0c4470 2020-11-20T11:50:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff3fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbffc0c10e0 0x7fbffc164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff3fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbffc0c10e0 0x7fbffc164680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45616/0 (socket says 172.21.15.164:45616) 2020-11-20T11:50:45.887 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff3fff700 1 -- 172.21.15.164:0/1173790086 learned_addr learned my addr 172.21.15.164:0/1173790086 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:45.887 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbffa59c700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbffc0bccf0 0x7fbffc155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.887 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbffad9d700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbffc0c4470 0x7fbffc1404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.887 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff3fff700 1 -- 172.21.15.164:0/1173790086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbffc0c4470 msgr2=0x7fbffc1404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.887 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff3fff700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbffc0c4470 0x7fbffc1404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff3fff700 1 -- 172.21.15.164:0/1173790086 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbffc0bccf0 msgr2=0x7fbffc155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff3fff700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbffc0bccf0 0x7fbffc155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff3fff700 1 -- 172.21.15.164:0/1173790086 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc1577c0 con 0x7fbffc0c10e0 2020-11-20T11:50:45.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbffa59c700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbffc0bccf0 0x7fbffc155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:45.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff3fff700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbffc0c10e0 0x7fbffc164680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fbfe400ebd0 tx=0x7fbfe4006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff27fc700 1 -- 172.21.15.164:0/1173790086 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe400c9d0 con 0x7fbffc0c10e0 2020-11-20T11:50:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff27fc700 1 -- 172.21.15.164:0/1173790086 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe400cb30 con 0x7fbffc0c10e0 2020-11-20T11:50:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc1540c0 con 0x7fbffc0c10e0 2020-11-20T11:50:45.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fbff27fc700 1 -- 172.21.15.164:0/1173790086 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe400ceb0 con 0x7fbffc0c10e0 2020-11-20T11:50:45.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.874+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc1409c0 con 0x7fbffc0c10e0 2020-11-20T11:50:45.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.875+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbffc140c40 con 0x7fbffc0c10e0 2020-11-20T11:50:45.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.876+0000 7fbff27fc700 1 -- 172.21.15.164:0/1173790086 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fbfe4012600 con 0x7fbffc0c10e0 2020-11-20T11:50:45.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.876+0000 7fbff27fc700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbfd8080670 0x7fbfd8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.876+0000 7fbff27fc700 1 -- 172.21.15.164:0/1173790086 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fbfe40a38f0 con 0x7fbffc0c10e0 2020-11-20T11:50:45.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.876+0000 7fbffa59c700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbfd8080670 0x7fbfd8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.876+0000 7fbff27fc700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] conn(0x7fbfd80893a0 0x7fbfd808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:45.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.876+0000 7fbff27fc700 1 -- 172.21.15.164:0/1173790086 --> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfd808be20 con 0x7fbfd80893a0 2020-11-20T11:50:45.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.876+0000 7fbff27fc700 1 -- 172.21.15.164:0/1173790086 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfe40a3c60 con 0x7fbffc0c10e0 2020-11-20T11:50:45.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.877+0000 7fbffa59c700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbfd8080670 0x7fbfd8082b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fbfec006f30 tx=0x7fbfec016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.892 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.877+0000 7fbffad9d700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] conn(0x7fbfd80893a0 0x7fbfd808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:45.892 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.877+0000 7fbffad9d700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] conn(0x7fbfd80893a0 0x7fbfd808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:45.892 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.878+0000 7fbff27fc700 1 -- 172.21.15.164:0/1173790086 <== osd.8 v2:172.21.15.188:6824/23470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fbfd808be20 con 0x7fbfd80893a0 2020-11-20T11:50:45.895 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.892+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 --> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbffc1584f0 con 0x7fbfd80893a0 2020-11-20T11:50:45.896 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.892+0000 7fbff27fc700 1 -- 172.21.15.164:0/1173790086 <== osd.8 v2:172.21.15.188:6824/23470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbffc1584f0 con 0x7fbfd80893a0 2020-11-20T11:50:45.897 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 >> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] conn(0x7fbfd80893a0 msgr2=0x7fbfd808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.897 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fc000fe4700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] conn(0x7fbfd80893a0 0x7fbfd808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:45.897 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbfd8080670 msgr2=0x7fbfd8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.898 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fc000fe4700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbfd8080670 0x7fbfd8082b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fbfec006f30 tx=0x7fbfec016000).stop 2020-11-20T11:50:45.898 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbffc0c10e0 msgr2=0x7fbffc164680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:45.898 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fc000fe4700 1 --2- 172.21.15.164:0/1173790086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbffc0c10e0 0x7fbffc164680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fbfe400ebd0 tx=0x7fbfe4006e30).stop 2020-11-20T11:50:45.898 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fbffad9d700 1 -- 172.21.15.164:0/1173790086 reap_dead start 2020-11-20T11:50:45.898 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 shutdown_connections 2020-11-20T11:50:45.899 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 >> 172.21.15.164:0/1173790086 conn(0x7fbffc0683b0 msgr2=0x7fbffc14e160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:45.899 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 shutdown_connections 2020-11-20T11:50:45.899 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:45.893+0000 7fc000fe4700 1 -- 172.21.15.164:0/1173790086 wait complete. 2020-11-20T11:50:45.907 INFO:teuthology.orchestra.run.smithi164.stdout:73014444037 2020-11-20T11:50:45.908 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2020-11-20T11:50:46.017 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.014+0000 7f271d9f2700 1 Processor -- start 2020-11-20T11:50:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.014+0000 7f271d9f2700 1 -- start start 2020-11-20T11:50:46.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.014+0000 7f271d9f2700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2718150640 0x7f27180c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.014+0000 7f271d9f2700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f27180c2680 0x7f27180c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.014+0000 7f271d9f2700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180c3e50 con 0x7f27181544c0 2020-11-20T11:50:46.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.014+0000 7f271d9f2700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2718151a30 con 0x7f27180c2680 2020-11-20T11:50:46.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.014+0000 7f271d9f2700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2718151c60 con 0x7f2718150640 2020-11-20T11:50:46.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f271d1f1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f27180c2680 0x7f27180c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f271c9f0700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2718150640 0x7f27180c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f271d1f1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f27180c2680 0x7f27180c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.164:44056/0 (socket says 172.21.15.164:44056) 2020-11-20T11:50:46.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f271d1f1700 1 -- 172.21.15.164:0/1183575216 learned_addr learned my addr 172.21.15.164:0/1183575216 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:46.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f27177fe700 1 -- 172.21.15.164:0/1183575216 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140227788 0 0) 0x7f27180c3e50 con 0x7f27181544c0 2020-11-20T11:50:46.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f27177fe700 1 -- 172.21.15.164:0/1183575216 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26fc003280 con 0x7f27181544c0 2020-11-20T11:50:46.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f271d1f1700 1 -- 172.21.15.164:0/1183575216 >> v2:172.21.15.188:3300/0 conn(0x7f2718150640 msgr2=0x7f27180c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:46.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f271d1f1700 1 --2- 172.21.15.164:0/1183575216 >> v2:172.21.15.188:3300/0 conn(0x7f2718150640 0x7f27180c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f271d1f1700 1 -- 172.21.15.164:0/1183575216 >> v1:172.21.15.188:6789/0 conn(0x7f27181544c0 legacy=0x7f27180c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f271d1f1700 1 -- 172.21.15.164:0/1183575216 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180c40e0 con 0x7f27180c2680 2020-11-20T11:50:46.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f271c9f0700 1 --2- 172.21.15.164:0/1183575216 >> v2:172.21.15.188:3300/0 conn(0x7f2718150640 0x7f27180c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:46.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f271d1f1700 1 --2- 172.21.15.164:0/1183575216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27180c2680 0x7f27180c79d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f271805c4a0 tx=0x7f27100092d0).ready entity=mon.0 client_cookie=6846c8935d1ae6b2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.015+0000 7f27177fe700 1 -- 172.21.15.164:0/1183575216 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000bbd0 con 0x7f27180c2680 2020-11-20T11:50:46.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.016+0000 7f27177fe700 1 -- 172.21.15.164:0/1183575216 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271000bd30 con 0x7f27180c2680 2020-11-20T11:50:46.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.016+0000 7f27177fe700 1 -- 172.21.15.164:0/1183575216 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000bea0 con 0x7f27180c2680 2020-11-20T11:50:46.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.016+0000 7f271d9f2700 1 -- 172.21.15.164:0/1183575216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27180c2680 msgr2=0x7f27180c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.016+0000 7f271d9f2700 1 --2- 172.21.15.164:0/1183575216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27180c2680 0x7f27180c79d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f271805c4a0 tx=0x7f27100092d0).stop 2020-11-20T11:50:46.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.016+0000 7f271d9f2700 1 -- 172.21.15.164:0/1183575216 shutdown_connections 2020-11-20T11:50:46.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.016+0000 7f271d9f2700 1 --2- 172.21.15.164:0/1183575216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27180c2680 0x7f27180c79d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.016+0000 7f271d9f2700 1 --2- 172.21.15.164:0/1183575216 >> v2:172.21.15.188:3300/0 conn(0x7f2718150640 0x7f27180c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.016+0000 7f271d9f2700 1 -- 172.21.15.164:0/1183575216 >> 172.21.15.164:0/1183575216 conn(0x7f271807ffb0 msgr2=0x7f27180803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:46.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.016+0000 7f271d9f2700 1 -- 172.21.15.164:0/1183575216 shutdown_connections 2020-11-20T11:50:46.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.016+0000 7f271d9f2700 1 -- 172.21.15.164:0/1183575216 wait complete. 2020-11-20T11:50:46.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.017+0000 7f271d9f2700 1 Processor -- start 2020-11-20T11:50:46.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.017+0000 7f271d9f2700 1 -- start start 2020-11-20T11:50:46.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f271d9f2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27180c2680 0x7f2718160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f271d9f2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2718150640 0x7f2718163f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f271d9f2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27181544c0 0x7f2718149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f271d9f2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180c5400 con 0x7f27181544c0 2020-11-20T11:50:46.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f271d9f2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180c5630 con 0x7f2718150640 2020-11-20T11:50:46.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f271d9f2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180c58d0 con 0x7f27180c2680 2020-11-20T11:50:46.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f2717fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2718150640 0x7f2718163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f2717fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2718150640 0x7f2718163f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45630/0 (socket says 172.21.15.164:45630) 2020-11-20T11:50:46.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f2717fff700 1 -- 172.21.15.164:0/1347091042 learned_addr learned my addr 172.21.15.164:0/1347091042 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:46.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f271c9f0700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27180c2680 0x7f2718160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f271d1f1700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27181544c0 0x7f2718149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f2717fff700 1 -- 172.21.15.164:0/1347091042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27180c2680 msgr2=0x7f2718160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f2717fff700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27180c2680 0x7f2718160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f2717fff700 1 -- 172.21.15.164:0/1347091042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27181544c0 msgr2=0x7f2718149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f2717fff700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27181544c0 0x7f2718149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f2717fff700 1 -- 172.21.15.164:0/1347091042 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180c5b70 con 0x7f2718150640 2020-11-20T11:50:46.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.018+0000 7f271d1f1700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27181544c0 0x7f2718149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:46.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.019+0000 7f2717fff700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2718150640 0x7f2718163f70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f270400c710 tx=0x7f2704007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.019+0000 7f2714ff9700 1 -- 172.21.15.164:0/1347091042 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704013410 con 0x7f2718150640 2020-11-20T11:50:46.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.019+0000 7f2714ff9700 1 -- 172.21.15.164:0/1347091042 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2704013570 con 0x7f2718150640 2020-11-20T11:50:46.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.019+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27180c5e10 con 0x7f2718150640 2020-11-20T11:50:46.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.019+0000 7f2714ff9700 1 -- 172.21.15.164:0/1347091042 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704013910 con 0x7f2718150640 2020-11-20T11:50:46.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.019+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2718163ad0 con 0x7f2718150640 2020-11-20T11:50:46.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.020+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2718044fa0 con 0x7f2718150640 2020-11-20T11:50:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.020+0000 7f2714ff9700 1 -- 172.21.15.164:0/1347091042 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2704010030 con 0x7f2718150640 2020-11-20T11:50:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.021+0000 7f2714ff9700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f26f0080670 0x7f26f0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.021+0000 7f2714ff9700 1 -- 172.21.15.164:0/1347091042 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f27040a2f60 con 0x7f2718150640 2020-11-20T11:50:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.021+0000 7f271c9f0700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f26f0080670 0x7f26f0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.021+0000 7f2714ff9700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] conn(0x7f26f00893a0 0x7f26f008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.021+0000 7f2714ff9700 1 -- 172.21.15.164:0/1347091042 --> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f26f008be20 con 0x7f26f00893a0 2020-11-20T11:50:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.021+0000 7f2714ff9700 1 -- 172.21.15.164:0/1347091042 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27040a32d0 con 0x7f2718150640 2020-11-20T11:50:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.021+0000 7f271d1f1700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] conn(0x7f26f00893a0 0x7f26f008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.021+0000 7f271c9f0700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f26f0080670 0x7f26f0082b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f270c006fd0 tx=0x7f270c006e30).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.022+0000 7f271d1f1700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] conn(0x7f26f00893a0 0x7f26f008b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.022+0000 7f2714ff9700 1 -- 172.21.15.164:0/1347091042 <== osd.9 v2:172.21.15.164:6826/23232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f26f008be20 con 0x7f26f00893a0 2020-11-20T11:50:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.036+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 --> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f271814fee0 con 0x7f26f00893a0 2020-11-20T11:50:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.036+0000 7f2714ff9700 1 -- 172.21.15.164:0/1347091042 <== osd.9 v2:172.21.15.164:6826/23232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f271814fee0 con 0x7f26f00893a0 2020-11-20T11:50:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] conn(0x7f26f00893a0 msgr2=0x7f26f008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d9f2700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] conn(0x7f26f00893a0 0x7f26f008b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f26f0080670 msgr2=0x7f26f0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d9f2700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f26f0080670 0x7f26f0082b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f270c006fd0 tx=0x7f270c006e30).stop 2020-11-20T11:50:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2718150640 msgr2=0x7f2718163f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d9f2700 1 --2- 172.21.15.164:0/1347091042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2718150640 0x7f2718163f70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f270400c710 tx=0x7f2704007aa0).stop 2020-11-20T11:50:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d1f1700 1 -- 172.21.15.164:0/1347091042 reap_dead start 2020-11-20T11:50:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 shutdown_connections 2020-11-20T11:50:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 >> 172.21.15.164:0/1347091042 conn(0x7f271807ffb0 msgr2=0x7f27180c1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 shutdown_connections 2020-11-20T11:50:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.037+0000 7f271d9f2700 1 -- 172.21.15.164:0/1347091042 wait complete. 2020-11-20T11:50:46.223 INFO:teuthology.orchestra.run.smithi164.stdout:73014444037 2020-11-20T11:50:46.224 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2020-11-20T11:50:46.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.347+0000 7f61a76bd700 1 Processor -- start 2020-11-20T11:50:46.351 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.347+0000 7f61a76bd700 1 -- start start 2020-11-20T11:50:46.352 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.348+0000 7f61a76bd700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f61a00c45e0 0x7f61a00bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.352 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.348+0000 7f61a76bd700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a00c12b0 con 0x7f61a00bccf0 2020-11-20T11:50:46.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.348+0000 7f61a76bd700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a0151780 con 0x7f61a00c4200 2020-11-20T11:50:46.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.348+0000 7f61a76bd700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a00c4a30 con 0x7f61a00c45e0 2020-11-20T11:50:46.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.348+0000 7f61a5c5a700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f61a00c45e0 0x7f61a00bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.348+0000 7f61a5459700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f61a00c4200 0x7f61a0150fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.164:40696/0 (socket says 172.21.15.164:40696) 2020-11-20T11:50:46.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.348+0000 7f61a5c5a700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f61a00c45e0 0x7f61a00bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.164:38906/0 (socket says 172.21.15.164:38906) 2020-11-20T11:50:46.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.348+0000 7f61a5459700 1 -- 172.21.15.164:0/896290234 learned_addr learned my addr 172.21.15.164:0/896290234 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:46.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.348+0000 7f61a5c5a700 1 -- 172.21.15.164:0/896290234 >> v1:172.21.15.188:6789/0 conn(0x7f61a00c4200 legacy=0x7f61a0150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f61a5c5a700 1 -- 172.21.15.164:0/896290234 >> v1:172.21.15.36:6789/0 conn(0x7f61a00bccf0 legacy=0x7f61a00c0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f61a5c5a700 1 -- 172.21.15.164:0/896290234 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a0151a20 con 0x7f61a00c45e0 2020-11-20T11:50:46.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f618ffff700 1 -- 172.21.15.164:0/896290234 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390785564 0 0) 0x7f61a00c12b0 con 0x7f61a00bccf0 2020-11-20T11:50:46.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f61a5c5a700 1 --2- 172.21.15.164:0/896290234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a00c45e0 0x7f61a00bf550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f61a00c0110 tx=0x7f6198009220).ready entity=mon.2 client_cookie=3db313c7f8e3d266 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f618ffff700 1 -- 172.21.15.164:0/896290234 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619800bbf0 con 0x7f61a00c45e0 2020-11-20T11:50:46.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f618ffff700 1 -- 172.21.15.164:0/896290234 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619800bd50 con 0x7f61a00c45e0 2020-11-20T11:50:46.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f618ffff700 1 -- 172.21.15.164:0/896290234 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198011610 con 0x7f61a00c45e0 2020-11-20T11:50:46.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f61a76bd700 1 -- 172.21.15.164:0/896290234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a00c45e0 msgr2=0x7f61a00bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f61a76bd700 1 --2- 172.21.15.164:0/896290234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a00c45e0 0x7f61a00bf550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f61a00c0110 tx=0x7f6198009220).stop 2020-11-20T11:50:46.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f61a76bd700 1 -- 172.21.15.164:0/896290234 shutdown_connections 2020-11-20T11:50:46.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f61a76bd700 1 --2- 172.21.15.164:0/896290234 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a00c45e0 0x7f61a00bf550 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f61a76bd700 1 -- 172.21.15.164:0/896290234 >> 172.21.15.164:0/896290234 conn(0x7f61a00678e0 msgr2=0x7f61a0067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:46.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f61a76bd700 1 -- 172.21.15.164:0/896290234 shutdown_connections 2020-11-20T11:50:46.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.349+0000 7f61a76bd700 1 -- 172.21.15.164:0/896290234 wait complete. 2020-11-20T11:50:46.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.350+0000 7f61a76bd700 1 Processor -- start 2020-11-20T11:50:46.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.350+0000 7f61a76bd700 1 -- start start 2020-11-20T11:50:46.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.351+0000 7f61a76bd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61a00bccf0 0x7f61a0160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.351+0000 7f61a76bd700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a00c4200 0x7f61a00c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.351+0000 7f61a76bd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61a00c45e0 0x7f61a01579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.351+0000 7f61a76bd700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a0160e60 con 0x7f61a00bccf0 2020-11-20T11:50:46.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.351+0000 7f61a76bd700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00c56d0 con 0x7f61a00c45e0 2020-11-20T11:50:46.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.351+0000 7f61a76bd700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00c5930 con 0x7f61a00c4200 2020-11-20T11:50:46.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.351+0000 7f61a5c5a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61a00c45e0 0x7f61a01579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.351+0000 7f61a5c5a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61a00c45e0 0x7f61a01579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45650/0 (socket says 172.21.15.164:45650) 2020-11-20T11:50:46.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.351+0000 7f61a5c5a700 1 -- 172.21.15.164:0/614666525 learned_addr learned my addr 172.21.15.164:0/614666525 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:46.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a4c58700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a00c4200 0x7f61a00c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a5459700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61a00bccf0 0x7f61a0160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a5c5a700 1 -- 172.21.15.164:0/614666525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a00c4200 msgr2=0x7f61a00c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a5c5a700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a00c4200 0x7f61a00c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a5c5a700 1 -- 172.21.15.164:0/614666525 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61a00bccf0 msgr2=0x7f61a0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a5c5a700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61a00bccf0 0x7f61a0160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a5c5a700 1 -- 172.21.15.164:0/614666525 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a00c5bd0 con 0x7f61a00c45e0 2020-11-20T11:50:46.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a5459700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61a00bccf0 0x7f61a0160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:46.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a5c5a700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61a00c45e0 0x7f61a01579d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f61980090b0 tx=0x7f6198016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f618d7fa700 1 -- 172.21.15.164:0/614666525 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198010800 con 0x7f61a00c45e0 2020-11-20T11:50:46.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f618d7fa700 1 -- 172.21.15.164:0/614666525 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6198010960 con 0x7f61a00c45e0 2020-11-20T11:50:46.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f618d7fa700 1 -- 172.21.15.164:0/614666525 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198010ce0 con 0x7f61a00c45e0 2020-11-20T11:50:46.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a00c5e70 con 0x7f61a00c45e0 2020-11-20T11:50:46.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.352+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a00c63b0 con 0x7f61a00c45e0 2020-11-20T11:50:46.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.353+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61a0069b70 con 0x7f61a00c45e0 2020-11-20T11:50:46.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.354+0000 7f618d7fa700 1 -- 172.21.15.164:0/614666525 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6198017070 con 0x7f61a00c45e0 2020-11-20T11:50:46.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.354+0000 7f618d7fa700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f6178080670 0x7f6178082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.354+0000 7f618d7fa700 1 -- 172.21.15.164:0/614666525 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f61980a5330 con 0x7f61a00c45e0 2020-11-20T11:50:46.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.354+0000 7f61a5459700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f6178080670 0x7f6178082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.354+0000 7f618d7fa700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] conn(0x7f61780893a0 0x7f617808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.354+0000 7f618d7fa700 1 -- 172.21.15.164:0/614666525 --> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f617808be20 con 0x7f61780893a0 2020-11-20T11:50:46.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.354+0000 7f618d7fa700 1 -- 172.21.15.164:0/614666525 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61980a7910 con 0x7f61a00c45e0 2020-11-20T11:50:46.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.354+0000 7f61a5459700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f6178080670 0x7f6178082b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f619c001530 tx=0x7f619c009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.355+0000 7f61a4c58700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] conn(0x7f61780893a0 0x7f617808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.355+0000 7f61a4c58700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] conn(0x7f61780893a0 0x7f617808b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.356+0000 7f618d7fa700 1 -- 172.21.15.164:0/614666525 <== osd.10 v2:172.21.15.36:6815/23022 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f617808be20 con 0x7f61780893a0 2020-11-20T11:50:46.373 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.370+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 --> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f61a00c8410 con 0x7f61780893a0 2020-11-20T11:50:46.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.370+0000 7f618d7fa700 1 -- 172.21.15.164:0/614666525 <== osd.10 v2:172.21.15.36:6815/23022 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f61a00c8410 con 0x7f61780893a0 2020-11-20T11:50:46.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.370+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 >> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] conn(0x7f61780893a0 msgr2=0x7f617808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.370+0000 7f61a76bd700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] conn(0x7f61780893a0 0x7f617808b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.370+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f6178080670 msgr2=0x7f6178082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.371+0000 7f61a76bd700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f6178080670 0x7f6178082b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f619c001530 tx=0x7f619c009040).stop 2020-11-20T11:50:46.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.371+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61a00c45e0 msgr2=0x7f61a01579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.371+0000 7f61a76bd700 1 --2- 172.21.15.164:0/614666525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61a00c45e0 0x7f61a01579d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f61980090b0 tx=0x7f6198016000).stop 2020-11-20T11:50:46.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.371+0000 7f61a5c5a700 1 -- 172.21.15.164:0/614666525 reap_dead start 2020-11-20T11:50:46.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.371+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 shutdown_connections 2020-11-20T11:50:46.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.371+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 >> 172.21.15.164:0/614666525 conn(0x7f61a00678e0 msgr2=0x7f61a0067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:46.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.371+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 shutdown_connections 2020-11-20T11:50:46.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.371+0000 7f61a76bd700 1 -- 172.21.15.164:0/614666525 wait complete. 2020-11-20T11:50:46.385 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:46.386 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2020-11-20T11:50:46.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.500+0000 7fc40ba37700 1 Processor -- start 2020-11-20T11:50:46.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.500+0000 7fc40ba37700 1 -- start start 2020-11-20T11:50:46.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc40ba37700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc4040650f0 0x7fc404062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc40ba37700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc404062a60 con 0x7fc404064d10 2020-11-20T11:50:46.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc40ba37700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4041520d0 con 0x7fc404151c40 2020-11-20T11:50:46.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc40ba37700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc404062520 con 0x7fc4040650f0 2020-11-20T11:50:46.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc409fd4700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc404151c40 0x7fc4041505f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55400/0 (socket says 172.21.15.164:55400) 2020-11-20T11:50:46.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc409fd4700 1 -- 172.21.15.164:0/1633827518 learned_addr learned my addr 172.21.15.164:0/1633827518 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:46.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc408fd2700 1 --2- 172.21.15.164:0/1633827518 >> v2:172.21.15.188:3300/0 conn(0x7fc4040650f0 0x7fc404062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539274466 0 0) 0x7fc4041520d0 con 0x7fc404151c40 2020-11-20T11:50:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec003280 con 0x7fc404151c40 2020-11-20T11:50:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849179548 0 0) 0x7fc404062a60 con 0x7fc404064d10 2020-11-20T11:50:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4041520d0 con 0x7fc404064d10 2020-11-20T11:50:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 579773265 0 0) 0x7fc3ec003280 con 0x7fc404151c40 2020-11-20T11:50:46.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 >> v2:172.21.15.188:3300/0 conn(0x7fc4040650f0 msgr2=0x7fc404062ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:46.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 --2- 172.21.15.164:0/1633827518 >> v2:172.21.15.188:3300/0 conn(0x7fc4040650f0 0x7fc404062ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 >> v1:172.21.15.36:6789/0 conn(0x7fc404064d10 legacy=0x7fc4040baf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4040627c0 con 0x7fc404151c40 2020-11-20T11:50:46.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fc3fc0018a0 con 0x7fc404151c40 2020-11-20T11:50:46.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc408fd2700 1 --2- 172.21.15.164:0/1633827518 >> v2:172.21.15.188:3300/0 conn(0x7fc4040650f0 0x7fc404062ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:46.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 >> v1:172.21.15.164:6789/0 conn(0x7fc404151c40 legacy=0x7fc4041505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.501+0000 7fc3f3fff700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3ec0039a0 0x7fc3ec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc3f3fff700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3ec004520 0x7fc3ec0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc3f3fff700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3ec004e90 0x7fc3ec00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404062520 con 0x7fc3ec004520 2020-11-20T11:50:46.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00bc60 con 0x7fc3ec004e90 2020-11-20T11:50:46.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00bda0 con 0x7fc3ec0039a0 2020-11-20T11:50:46.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc409fd4700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3ec004e90 0x7fc3ec00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc4097d3700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3ec0039a0 0x7fc3ec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc408fd2700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3ec004520 0x7fc3ec0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc409fd4700 1 -- 172.21.15.164:0/1633827518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3ec0039a0 msgr2=0x7fc3ec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:46.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc409fd4700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3ec0039a0 0x7fc3ec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc409fd4700 1 -- 172.21.15.164:0/1633827518 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3ec004520 msgr2=0x7fc3ec0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:46.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc409fd4700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3ec004520 0x7fc3ec0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc409fd4700 1 -- 172.21.15.164:0/1633827518 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec003280 con 0x7fc3ec004e90 2020-11-20T11:50:46.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc409fd4700 1 -- 172.21.15.164:0/1633827518 reap_dead start 2020-11-20T11:50:46.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc409fd4700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3ec004e90 0x7fc3ec00b770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc3fc00c5b0 tx=0x7fc3fc007a60).ready entity=mon.1 client_cookie=5a1b959a2988b130 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc005bc0 con 0x7fc3ec004e90 2020-11-20T11:50:46.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc005d20 con 0x7fc3ec004e90 2020-11-20T11:50:46.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.502+0000 7fc3f3fff700 1 -- 172.21.15.164:0/1633827518 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc007320 con 0x7fc3ec004e90 2020-11-20T11:50:46.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.503+0000 7fc40ba37700 1 -- 172.21.15.164:0/1633827518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3ec004e90 msgr2=0x7fc3ec00b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.503+0000 7fc40ba37700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3ec004e90 0x7fc3ec00b770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc3fc00c5b0 tx=0x7fc3fc007a60).stop 2020-11-20T11:50:46.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.503+0000 7fc40ba37700 1 -- 172.21.15.164:0/1633827518 shutdown_connections 2020-11-20T11:50:46.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.503+0000 7fc40ba37700 1 --2- 172.21.15.164:0/1633827518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3ec004e90 0x7fc3ec00b770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.503+0000 7fc40ba37700 1 -- 172.21.15.164:0/1633827518 >> 172.21.15.164:0/1633827518 conn(0x7fc4040c55c0 msgr2=0x7fc4040c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:46.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.503+0000 7fc40ba37700 1 -- 172.21.15.164:0/1633827518 shutdown_connections 2020-11-20T11:50:46.517 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.503+0000 7fc40ba37700 1 -- 172.21.15.164:0/1633827518 wait complete. 2020-11-20T11:50:46.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.504+0000 7fc40ba37700 1 Processor -- start 2020-11-20T11:50:46.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.504+0000 7fc40ba37700 1 -- start start 2020-11-20T11:50:46.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc40ba37700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3ec004e90 0x7fc404160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc40ba37700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4041533c0 0x7fc40414ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc40ba37700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc40414f260 0x7fc404161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.521 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc40ba37700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404161040 con 0x7fc3ec004e90 2020-11-20T11:50:46.521 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc40ba37700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404153cf0 con 0x7fc40414f260 2020-11-20T11:50:46.522 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc40ba37700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4041542d0 con 0x7fc4041533c0 2020-11-20T11:50:46.522 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc409fd4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc40414f260 0x7fc404161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.522 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc409fd4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc40414f260 0x7fc404161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45672/0 (socket says 172.21.15.164:45672) 2020-11-20T11:50:46.522 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc409fd4700 1 -- 172.21.15.164:0/3470053372 learned_addr learned my addr 172.21.15.164:0/3470053372 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:46.522 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc4097d3700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3ec004e90 0x7fc404160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc408fd2700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4041533c0 0x7fc40414ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc409fd4700 1 -- 172.21.15.164:0/3470053372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4041533c0 msgr2=0x7fc40414ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc409fd4700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4041533c0 0x7fc40414ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc409fd4700 1 -- 172.21.15.164:0/3470053372 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3ec004e90 msgr2=0x7fc404160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc409fd4700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3ec004e90 0x7fc404160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc409fd4700 1 -- 172.21.15.164:0/3470053372 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404154570 con 0x7fc40414f260 2020-11-20T11:50:46.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc4097d3700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3ec004e90 0x7fc404160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:46.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc409fd4700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc40414f260 0x7fc404161540 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fc4040684e0 tx=0x7fc3fc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc3f17fa700 1 -- 172.21.15.164:0/3470053372 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0048c0 con 0x7fc40414f260 2020-11-20T11:50:46.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc3f17fa700 1 -- 172.21.15.164:0/3470053372 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc004a20 con 0x7fc40414f260 2020-11-20T11:50:46.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc404154810 con 0x7fc40414f260 2020-11-20T11:50:46.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc3f17fa700 1 -- 172.21.15.164:0/3470053372 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc004da0 con 0x7fc40414f260 2020-11-20T11:50:46.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.505+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc404154d50 con 0x7fc40414f260 2020-11-20T11:50:46.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.506+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc404069b70 con 0x7fc40414f260 2020-11-20T11:50:46.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.507+0000 7fc3f17fa700 1 -- 172.21.15.164:0/3470053372 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc3fc027070 con 0x7fc40414f260 2020-11-20T11:50:46.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.507+0000 7fc3f17fa700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc3dc080670 0x7fc3dc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.507+0000 7fc3f17fa700 1 -- 172.21.15.164:0/3470053372 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc3fc0a3ed0 con 0x7fc40414f260 2020-11-20T11:50:46.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.507+0000 7fc4097d3700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc3dc080670 0x7fc3dc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.508+0000 7fc3f17fa700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] conn(0x7fc3dc0893a0 0x7fc3dc08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.508+0000 7fc3f17fa700 1 -- 172.21.15.164:0/3470053372 --> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3dc08be20 con 0x7fc3dc0893a0 2020-11-20T11:50:46.527 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.508+0000 7fc3f17fa700 1 -- 172.21.15.164:0/3470053372 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3fc0a4240 con 0x7fc40414f260 2020-11-20T11:50:46.527 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.508+0000 7fc4097d3700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc3dc080670 0x7fc3dc082b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc3f4000c00 tx=0x7fc3f4009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.527 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.508+0000 7fc408fd2700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] conn(0x7fc3dc0893a0 0x7fc3dc08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.527 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.508+0000 7fc408fd2700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] conn(0x7fc3dc0893a0 0x7fc3dc08b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.527 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.509+0000 7fc3f17fa700 1 -- 172.21.15.164:0/3470053372 <== osd.11 v2:172.21.15.188:6815/23471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fc3dc08be20 con 0x7fc3dc0893a0 2020-11-20T11:50:46.529 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.523+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 --> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc404154ee0 con 0x7fc3dc0893a0 2020-11-20T11:50:46.529 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.523+0000 7fc3f17fa700 1 -- 172.21.15.164:0/3470053372 <== osd.11 v2:172.21.15.188:6815/23471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc404154ee0 con 0x7fc3dc0893a0 2020-11-20T11:50:46.529 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 >> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] conn(0x7fc3dc0893a0 msgr2=0x7fc3dc08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.530 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc40ba37700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] conn(0x7fc3dc0893a0 0x7fc3dc08b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.530 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc3dc080670 msgr2=0x7fc3dc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.530 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc40ba37700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc3dc080670 0x7fc3dc082b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc3f4000c00 tx=0x7fc3f4009040).stop 2020-11-20T11:50:46.530 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc40414f260 msgr2=0x7fc404161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.530 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc40ba37700 1 --2- 172.21.15.164:0/3470053372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc40414f260 0x7fc404161540 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fc4040684e0 tx=0x7fc3fc015000).stop 2020-11-20T11:50:46.531 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc409fd4700 1 -- 172.21.15.164:0/3470053372 reap_dead start 2020-11-20T11:50:46.531 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 shutdown_connections 2020-11-20T11:50:46.531 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 >> 172.21.15.164:0/3470053372 conn(0x7fc4040c55c0 msgr2=0x7fc4040c0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:46.531 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 shutdown_connections 2020-11-20T11:50:46.531 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.524+0000 7fc40ba37700 1 -- 172.21.15.164:0/3470053372 wait complete. 2020-11-20T11:50:46.539 INFO:teuthology.orchestra.run.smithi164.stdout:73014444037 2020-11-20T11:50:46.540 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-20T11:50:46.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.646+0000 7ff54c7bf700 1 Processor -- start 2020-11-20T11:50:46.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.646+0000 7ff54c7bf700 1 -- start start 2020-11-20T11:50:46.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff54c7bf700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff5440c4200 0x7ff5440bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff54c7bf700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff5440c0ba0 0x7ff5440bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff54c7bf700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff544151780 con 0x7ff5440c45e0 2020-11-20T11:50:46.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff54c7bf700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5440c4a60 con 0x7ff5440c0ba0 2020-11-20T11:50:46.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff54c7bf700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff544151a20 con 0x7ff5440c4200 2020-11-20T11:50:46.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff54a55b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff5440c4200 0x7ff5440bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff549d5a700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff5440c45e0 0x7ff544150fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55418/0 (socket says 172.21.15.164:55418) 2020-11-20T11:50:46.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff549d5a700 1 -- 172.21.15.164:0/3153608051 learned_addr learned my addr 172.21.15.164:0/3153608051 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:46.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff54a55b700 1 -- 172.21.15.164:0/3153608051 >> v2:172.21.15.36:3300/0 conn(0x7ff5440c0ba0 msgr2=0x7ff5440bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:46.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff54a55b700 1 --2- 172.21.15.164:0/3153608051 >> v2:172.21.15.36:3300/0 conn(0x7ff5440c0ba0 0x7ff5440bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:46.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff54a55b700 1 -- 172.21.15.164:0/3153608051 >> v1:172.21.15.164:6789/0 conn(0x7ff5440c45e0 legacy=0x7ff544150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff54a55b700 1 -- 172.21.15.164:0/3153608051 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544151cc0 con 0x7ff5440c4200 2020-11-20T11:50:46.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.647+0000 7ff549559700 1 -- 172.21.15.164:0/3153608051 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45907360 0 0) 0x7ff544151780 con 0x7ff5440c45e0 2020-11-20T11:50:46.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff54a55b700 1 --2- 172.21.15.164:0/3153608051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 0x7ff5440bccf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff544081020 tx=0x7ff540006e30).ready entity=mon.1 client_cookie=9bd39e84554c0b2f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff549559700 1 -- 172.21.15.164:0/3153608051 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5400097b0 con 0x7ff5440c4200 2020-11-20T11:50:46.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff549559700 1 -- 172.21.15.164:0/3153608051 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540000e90 con 0x7ff5440c4200 2020-11-20T11:50:46.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff549559700 1 -- 172.21.15.164:0/3153608051 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540009b20 con 0x7ff5440c4200 2020-11-20T11:50:46.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff54c7bf700 1 -- 172.21.15.164:0/3153608051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 msgr2=0x7ff5440bccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff54c7bf700 1 --2- 172.21.15.164:0/3153608051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 0x7ff5440bccf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff544081020 tx=0x7ff540006e30).stop 2020-11-20T11:50:46.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff54c7bf700 1 -- 172.21.15.164:0/3153608051 shutdown_connections 2020-11-20T11:50:46.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff54c7bf700 1 --2- 172.21.15.164:0/3153608051 >> v2:172.21.15.36:3300/0 conn(0x7ff5440c0ba0 0x7ff5440bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:46.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff54c7bf700 1 --2- 172.21.15.164:0/3153608051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 0x7ff5440bccf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff54c7bf700 1 -- 172.21.15.164:0/3153608051 >> 172.21.15.164:0/3153608051 conn(0x7ff5440678e0 msgr2=0x7ff544067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:46.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff54c7bf700 1 -- 172.21.15.164:0/3153608051 shutdown_connections 2020-11-20T11:50:46.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.648+0000 7ff54c7bf700 1 -- 172.21.15.164:0/3153608051 wait complete. 2020-11-20T11:50:46.661 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.649+0000 7ff54c7bf700 1 Processor -- start 2020-11-20T11:50:46.662 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.649+0000 7ff54c7bf700 1 -- start start 2020-11-20T11:50:46.662 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff54c7bf700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5440c0ba0 0x7ff5440c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.662 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff54c7bf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 0x7ff5441645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.662 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff54c7bf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5440c45e0 0x7ff5441556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff54c7bf700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff544158020 con 0x7ff5440c45e0 2020-11-20T11:50:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff54c7bf700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440c57f0 con 0x7ff5440c4200 2020-11-20T11:50:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff54c7bf700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440c66d0 con 0x7ff5440c0ba0 2020-11-20T11:50:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff549d5a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 0x7ff5441645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff549d5a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 0x7ff5441645a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45684/0 (socket says 172.21.15.164:45684) 2020-11-20T11:50:46.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff549d5a700 1 -- 172.21.15.164:0/2546678982 learned_addr learned my addr 172.21.15.164:0/2546678982 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:46.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff54a55b700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5440c0ba0 0x7ff5440c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff549d5a700 1 -- 172.21.15.164:0/2546678982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5440c0ba0 msgr2=0x7ff5440c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.650+0000 7ff549d5a700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5440c0ba0 0x7ff5440c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.651+0000 7ff549d5a700 1 -- 172.21.15.164:0/2546678982 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5440c45e0 msgr2=0x7ff5441556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.651+0000 7ff549d5a700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5440c45e0 0x7ff5441556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:46.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.651+0000 7ff549d5a700 1 -- 172.21.15.164:0/2546678982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544155bc0 con 0x7ff5440c4200 2020-11-20T11:50:46.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.651+0000 7ff54a55b700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5440c0ba0 0x7ff5440c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:46.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.651+0000 7ff549d5a700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 0x7ff5441645a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff53400c760 tx=0x7ff534007d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.651+0000 7ff5327fc700 1 -- 172.21.15.164:0/2546678982 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534007320 con 0x7ff5440c4200 2020-11-20T11:50:46.666 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.651+0000 7ff5327fc700 1 -- 172.21.15.164:0/2546678982 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff534007480 con 0x7ff5440c4200 2020-11-20T11:50:46.666 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.651+0000 7ff5327fc700 1 -- 172.21.15.164:0/2546678982 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534005840 con 0x7ff5440c4200 2020-11-20T11:50:46.666 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.651+0000 7ff54c7bf700 1 -- 172.21.15.164:0/2546678982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff544158210 con 0x7ff5440c4200 2020-11-20T11:50:46.666 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.651+0000 7ff54c7bf700 1 -- 172.21.15.164:0/2546678982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5440c6900 con 0x7ff5440c4200 2020-11-20T11:50:46.666 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.652+0000 7ff54c7bf700 1 -- 172.21.15.164:0/2546678982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff544069b70 con 0x7ff5440c4200 2020-11-20T11:50:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.652+0000 7ff5327fc700 1 -- 172.21.15.164:0/2546678982 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff534010030 con 0x7ff5440c4200 2020-11-20T11:50:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.653+0000 7ff5327fc700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff51c080670 0x7ff51c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.653+0000 7ff5327fc700 1 -- 172.21.15.164:0/2546678982 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff5340a2780 con 0x7ff5440c4200 2020-11-20T11:50:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.653+0000 7ff54a55b700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff51c080670 0x7ff51c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.653+0000 7ff54a55b700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff51c080670 0x7ff51c082b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff54000b190 tx=0x7ff540015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.656+0000 7ff5327fc700 1 -- 172.21.15.164:0/2546678982 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff534077190 con 0x7ff5440c4200 2020-11-20T11:50:46.798 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.795+0000 7ff54c7bf700 1 -- 172.21.15.164:0/2546678982 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff5440c4c10 con 0x7ff5440c4200 2020-11-20T11:50:46.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.795+0000 7ff5327fc700 1 -- 172.21.15.164:0/2546678982 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff53407a7b0 con 0x7ff5440c4200 2020-11-20T11:50:46.799 INFO:teuthology.orchestra.run.smithi164.stdout:73014444037 2020-11-20T11:50:46.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.796+0000 7ff54c7bf700 1 -- 172.21.15.164:0/2546678982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff51c080670 msgr2=0x7ff51c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.796+0000 7ff54c7bf700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff51c080670 0x7ff51c082b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff54000b190 tx=0x7ff540015000).stop 2020-11-20T11:50:46.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.796+0000 7ff54c7bf700 1 -- 172.21.15.164:0/2546678982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 msgr2=0x7ff5441645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.796+0000 7ff54c7bf700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 0x7ff5441645a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff53400c760 tx=0x7ff534007d20).stop 2020-11-20T11:50:46.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.797+0000 7ff54c7bf700 1 -- 172.21.15.164:0/2546678982 shutdown_connections 2020-11-20T11:50:46.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.797+0000 7ff54c7bf700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff51c080670 0x7ff51c082b30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.797+0000 7ff54c7bf700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5440c45e0 0x7ff5441556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.797+0000 7ff54c7bf700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff5440c0ba0 0x7ff5440c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.797+0000 7ff54c7bf700 1 --2- 172.21.15.164:0/2546678982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5440c4200 0x7ff5441645a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.797+0000 7ff54c7bf700 1 -- 172.21.15.164:0/2546678982 >> 172.21.15.164:0/2546678982 conn(0x7ff5440678e0 msgr2=0x7ff544153430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.797+0000 7ff54c7bf700 1 -- 172.21.15.164:0/2546678982 shutdown_connections 2020-11-20T11:50:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.797+0000 7ff54c7bf700 1 -- 172.21.15.164:0/2546678982 wait complete. 2020-11-20T11:50:46.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444037 for osd.0 2020-11-20T11:50:46.812 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-11-20T11:50:46.922 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.918+0000 7f5bd4df6700 1 Processor -- start 2020-11-20T11:50:46.922 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.918+0000 7f5bd4df6700 1 -- start start 2020-11-20T11:50:46.924 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bd4df6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5bd00c4470 0x7f5bd00c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bd4df6700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5bd00bf680 0x7f5bd00bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bd4df6700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd01555a0 con 0x7f5bd00bccf0 2020-11-20T11:50:46.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bd4df6700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd00c0000 con 0x7f5bd00c4470 2020-11-20T11:50:46.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bd4df6700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd01517d0 con 0x7f5bd00bf680 2020-11-20T11:50:46.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bce59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5bd00c4470 0x7f5bd00c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bcdd9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f5bd00bccf0 0x7f5bd00c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.164:41564/0 (socket says 172.21.15.164:41564) 2020-11-20T11:50:46.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bce59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5bd00c4470 0x7f5bd00c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.164:44124/0 (socket says 172.21.15.164:44124) 2020-11-20T11:50:46.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bce59c700 1 -- 172.21.15.164:0/4258015609 learned_addr learned my addr 172.21.15.164:0/4258015609 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:46.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bced9d700 1 --2- 172.21.15.164:0/4258015609 >> v2:172.21.15.188:3300/0 conn(0x7f5bd00bf680 0x7f5bd00bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bcd59a700 1 -- 172.21.15.164:0/4258015609 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061293425 0 0) 0x7f5bd01555a0 con 0x7f5bd00bccf0 2020-11-20T11:50:46.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bcd59a700 1 -- 172.21.15.164:0/4258015609 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb4003280 con 0x7f5bd00bccf0 2020-11-20T11:50:46.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bced9d700 1 -- 172.21.15.164:0/4258015609 >> v2:172.21.15.36:3300/0 conn(0x7f5bd00c4470 msgr2=0x7f5bd00c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:46.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bced9d700 1 --2- 172.21.15.164:0/4258015609 >> v2:172.21.15.36:3300/0 conn(0x7f5bd00c4470 0x7f5bd00c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bced9d700 1 -- 172.21.15.164:0/4258015609 >> v1:172.21.15.36:6789/0 conn(0x7f5bd00bccf0 legacy=0x7f5bd00c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bced9d700 1 -- 172.21.15.164:0/4258015609 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0151a70 con 0x7f5bd00bf680 2020-11-20T11:50:46.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.919+0000 7f5bce59c700 1 --2- 172.21.15.164:0/4258015609 >> v2:172.21.15.36:3300/0 conn(0x7f5bd00c4470 0x7f5bd00c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:50:46.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bced9d700 1 --2- 172.21.15.164:0/4258015609 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5bd00bf680 0x7f5bd00bfb10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5bd00c51c0 tx=0x7f5bc8009220).ready entity=mon.2 client_cookie=ddb46ff76b7777f2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bcd59a700 1 -- 172.21.15.164:0/4258015609 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc800b9e0 con 0x7f5bd00bf680 2020-11-20T11:50:46.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bcd59a700 1 -- 172.21.15.164:0/4258015609 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc800bb40 con 0x7f5bd00bf680 2020-11-20T11:50:46.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bcd59a700 1 -- 172.21.15.164:0/4258015609 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8011400 con 0x7f5bd00bf680 2020-11-20T11:50:46.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bd4df6700 1 -- 172.21.15.164:0/4258015609 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5bd00bf680 msgr2=0x7f5bd00bfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bd4df6700 1 --2- 172.21.15.164:0/4258015609 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5bd00bf680 0x7f5bd00bfb10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5bd00c51c0 tx=0x7f5bc8009220).stop 2020-11-20T11:50:46.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bd4df6700 1 -- 172.21.15.164:0/4258015609 shutdown_connections 2020-11-20T11:50:46.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bd4df6700 1 --2- 172.21.15.164:0/4258015609 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5bd00bf680 0x7f5bd00bfb10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bd4df6700 1 --2- 172.21.15.164:0/4258015609 >> v2:172.21.15.36:3300/0 conn(0x7f5bd00c4470 0x7f5bd00c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bd4df6700 1 -- 172.21.15.164:0/4258015609 >> 172.21.15.164:0/4258015609 conn(0x7f5bd00683b0 msgr2=0x7f5bd0061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:46.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bd4df6700 1 -- 172.21.15.164:0/4258015609 shutdown_connections 2020-11-20T11:50:46.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.920+0000 7f5bd4df6700 1 -- 172.21.15.164:0/4258015609 wait complete. 2020-11-20T11:50:46.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.921+0000 7f5bd4df6700 1 Processor -- start 2020-11-20T11:50:46.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.921+0000 7f5bd4df6700 1 -- start start 2020-11-20T11:50:46.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.922+0000 7f5bd4df6700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5bd00bccf0 0x7f5bd0164180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.922+0000 7f5bd4df6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd00bf680 0x7f5bd0112230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.922+0000 7f5bd4df6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5bd00c4470 0x7f5bd01547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.922+0000 7f5bd4df6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd0164670 con 0x7f5bd00c4470 2020-11-20T11:50:46.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.922+0000 7f5bd4df6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd014df20 con 0x7f5bd00bf680 2020-11-20T11:50:46.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.922+0000 7f5bd4df6700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd0160780 con 0x7f5bd00bccf0 2020-11-20T11:50:46.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.922+0000 7f5bcdd9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd00bf680 0x7f5bd0112230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.922+0000 7f5bcdd9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd00bf680 0x7f5bd0112230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45700/0 (socket says 172.21.15.164:45700) 2020-11-20T11:50:46.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.922+0000 7f5bcdd9b700 1 -- 172.21.15.164:0/1294261368 learned_addr learned my addr 172.21.15.164:0/1294261368 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:46.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.922+0000 7f5bce59c700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5bd00bccf0 0x7f5bd0164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bced9d700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5bd00c4470 0x7f5bd01547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bcdd9b700 1 -- 172.21.15.164:0/1294261368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5bd00bccf0 msgr2=0x7f5bd0164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bcdd9b700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5bd00bccf0 0x7f5bd0164180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bcdd9b700 1 -- 172.21.15.164:0/1294261368 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5bd00c4470 msgr2=0x7f5bd01547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:46.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bcdd9b700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5bd00c4470 0x7f5bd01547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:46.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bcdd9b700 1 -- 172.21.15.164:0/1294261368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0160a20 con 0x7f5bd00bf680 2020-11-20T11:50:46.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bcdd9b700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd00bf680 0x7f5bd0112230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5bc000c710 tx=0x7f5bc0007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bbe7fc700 1 -- 172.21.15.164:0/1294261368 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00072e0 con 0x7f5bd00bf680 2020-11-20T11:50:46.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bbe7fc700 1 -- 172.21.15.164:0/1294261368 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc0005570 con 0x7f5bd00bf680 2020-11-20T11:50:46.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bbe7fc700 1 -- 172.21.15.164:0/1294261368 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0005910 con 0x7f5bd00bf680 2020-11-20T11:50:46.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bd4df6700 1 -- 172.21.15.164:0/1294261368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd0160cc0 con 0x7f5bd00bf680 2020-11-20T11:50:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.923+0000 7f5bd4df6700 1 -- 172.21.15.164:0/1294261368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd0154310 con 0x7f5bd00bf680 2020-11-20T11:50:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.924+0000 7f5bd4df6700 1 -- 172.21.15.164:0/1294261368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd0161120 con 0x7f5bd00bf680 2020-11-20T11:50:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.925+0000 7f5bbe7fc700 1 -- 172.21.15.164:0/1294261368 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5bc0010070 con 0x7f5bd00bf680 2020-11-20T11:50:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.925+0000 7f5bbe7fc700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5ba4080670 0x7f5ba4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.925+0000 7f5bbe7fc700 1 -- 172.21.15.164:0/1294261368 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f5bc00a2050 con 0x7f5bd00bf680 2020-11-20T11:50:46.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.925+0000 7f5bce59c700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5ba4080670 0x7f5ba4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:46.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.925+0000 7f5bce59c700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5ba4080670 0x7f5ba4082b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5bc4006a30 tx=0x7f5bc4006ef0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:46.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:46.928+0000 7f5bbe7fc700 1 -- 172.21.15.164:0/1294261368 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5bc0076a60 con 0x7f5bd00bf680 2020-11-20T11:50:47.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.068+0000 7f5bd4df6700 1 -- 172.21.15.164:0/1294261368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5bd01562a0 con 0x7f5bd00bf680 2020-11-20T11:50:47.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.069+0000 7f5bbe7fc700 1 -- 172.21.15.164:0/1294261368 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bc0018020 con 0x7f5bd00bf680 2020-11-20T11:50:47.073 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:47.074 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 -- 172.21.15.164:0/1294261368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5ba4080670 msgr2=0x7f5ba4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.074 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5ba4080670 0x7f5ba4082b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5bc4006a30 tx=0x7f5bc4006ef0).stop 2020-11-20T11:50:47.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 -- 172.21.15.164:0/1294261368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd00bf680 msgr2=0x7f5bd0112230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd00bf680 0x7f5bd0112230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5bc000c710 tx=0x7f5bc0007ad0).stop 2020-11-20T11:50:47.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 -- 172.21.15.164:0/1294261368 shutdown_connections 2020-11-20T11:50:47.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5ba4080670 0x7f5ba4082b30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5bd00c4470 0x7f5bd01547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5bd00bccf0 0x7f5bd0164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 --2- 172.21.15.164:0/1294261368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bd00bf680 0x7f5bd0112230 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 -- 172.21.15.164:0/1294261368 >> 172.21.15.164:0/1294261368 conn(0x7f5bd00683b0 msgr2=0x7f5bd00c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:47.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 -- 172.21.15.164:0/1294261368 shutdown_connections 2020-11-20T11:50:47.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.070+0000 7f5bd4df6700 1 -- 172.21.15.164:0/1294261368 wait complete. 2020-11-20T11:50:47.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.1 2020-11-20T11:50:47.086 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-11-20T11:50:47.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.206+0000 7f11adbb2700 1 Processor -- start 2020-11-20T11:50:47.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.206+0000 7f11adbb2700 1 -- start start 2020-11-20T11:50:47.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11adbb2700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a81555a0 con 0x7f11a80bfd90 2020-11-20T11:50:47.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11adbb2700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a81517d0 con 0x7f11a80bccf0 2020-11-20T11:50:47.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11adbb2700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a8151a70 con 0x7f11a80c4470 2020-11-20T11:50:47.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a6ffd700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f11a80bccf0 0x7f11a80bf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55446/0 (socket says 172.21.15.164:55446) 2020-11-20T11:50:47.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a6ffd700 1 -- 172.21.15.164:0/1325805524 learned_addr learned my addr 172.21.15.164:0/1325805524 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:47.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903527368 0 0) 0x7f11a81517d0 con 0x7f11a80bccf0 2020-11-20T11:50:47.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1188003280 con 0x7f11a80bccf0 2020-11-20T11:50:47.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475533014 0 0) 0x7f11a8151a70 con 0x7f11a80c4470 2020-11-20T11:50:47.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a81517d0 con 0x7f11a80c4470 2020-11-20T11:50:47.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 626688961 0 0) 0x7f1188003280 con 0x7f11a80bccf0 2020-11-20T11:50:47.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 >> v1:172.21.15.188:6789/0 conn(0x7f11a80c4470 legacy=0x7f11a80c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 >> v1:172.21.15.36:6789/0 conn(0x7f11a80bfd90 legacy=0x7f11a815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8151d10 con 0x7f11a80bccf0 2020-11-20T11:50:47.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7f1198001520 con 0x7f11a80bccf0 2020-11-20T11:50:47.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 >> v1:172.21.15.164:6789/0 conn(0x7f11a80bccf0 legacy=0x7f11a80bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11880039d0 0x7f1188003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1188004520 0x7f11880049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f118800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118800bc60 con 0x7f11880039d0 2020-11-20T11:50:47.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118800bda0 con 0x7f1188004ee0 2020-11-20T11:50:47.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.207+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118800bf10 con 0x7f1188004520 2020-11-20T11:50:47.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a7fff700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f118800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a6ffd700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1188004520 0x7f11880049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a77fe700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11880039d0 0x7f1188003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a7fff700 1 -- 172.21.15.164:0/1325805524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1188004520 msgr2=0x7f11880049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:47.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a7fff700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1188004520 0x7f11880049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a7fff700 1 -- 172.21.15.164:0/1325805524 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11880039d0 msgr2=0x7f1188003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:47.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a7fff700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11880039d0 0x7f1188003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a7fff700 1 -- 172.21.15.164:0/1325805524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188003280 con 0x7f1188004ee0 2020-11-20T11:50:47.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a7fff700 1 -- 172.21.15.164:0/1325805524 reap_dead start 2020-11-20T11:50:47.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a7fff700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f118800b770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f11a0001ec0 tx=0x7f11a0007f50).ready entity=mon.1 client_cookie=a48c823cf745929c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:47.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a000c930 con 0x7f1188004ee0 2020-11-20T11:50:47.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a000ca90 con 0x7f1188004ee0 2020-11-20T11:50:47.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11a67fc700 1 -- 172.21.15.164:0/1325805524 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a000ce50 con 0x7f1188004ee0 2020-11-20T11:50:47.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11adbb2700 1 -- 172.21.15.164:0/1325805524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 msgr2=0x7f118800b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.208+0000 7f11adbb2700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f118800b770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f11a0001ec0 tx=0x7f11a0007f50).stop 2020-11-20T11:50:47.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.209+0000 7f11adbb2700 1 -- 172.21.15.164:0/1325805524 shutdown_connections 2020-11-20T11:50:47.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.209+0000 7f11adbb2700 1 --2- 172.21.15.164:0/1325805524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f118800b770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.209+0000 7f11adbb2700 1 -- 172.21.15.164:0/1325805524 >> 172.21.15.164:0/1325805524 conn(0x7f11a80683b0 msgr2=0x7f11a8061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:47.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.209+0000 7f11adbb2700 1 -- 172.21.15.164:0/1325805524 shutdown_connections 2020-11-20T11:50:47.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.209+0000 7f11adbb2700 1 -- 172.21.15.164:0/1325805524 wait complete. 2020-11-20T11:50:47.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.210+0000 7f11adbb2700 1 Processor -- start 2020-11-20T11:50:47.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.210+0000 7f11adbb2700 1 -- start start 2020-11-20T11:50:47.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11adbb2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f11a80c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11adbb2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11a8152510 0x7f11a8164600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11adbb2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11a8143df0 0x7f11a8156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11adbb2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a80c80c0 con 0x7f11a8152510 2020-11-20T11:50:47.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11adbb2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a8164af0 con 0x7f1188004ee0 2020-11-20T11:50:47.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11adbb2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a8160850 con 0x7f11a8143df0 2020-11-20T11:50:47.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a77fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f11a80c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a77fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f11a80c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45718/0 (socket says 172.21.15.164:45718) 2020-11-20T11:50:47.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a77fe700 1 -- 172.21.15.164:0/3095166755 learned_addr learned my addr 172.21.15.164:0/3095166755 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:47.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a7fff700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11a8143df0 0x7f11a8156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a6ffd700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11a8152510 0x7f11a8164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a77fe700 1 -- 172.21.15.164:0/3095166755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11a8143df0 msgr2=0x7f11a8156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a77fe700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11a8143df0 0x7f11a8156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a77fe700 1 -- 172.21.15.164:0/3095166755 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11a8152510 msgr2=0x7f11a8164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a77fe700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11a8152510 0x7f11a8164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a77fe700 1 -- 172.21.15.164:0/3095166755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8160af0 con 0x7f1188004ee0 2020-11-20T11:50:47.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a6ffd700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11a8152510 0x7f11a8164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:47.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a7fff700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11a8143df0 0x7f11a8156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:47.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11a77fe700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f11a80c7bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1190002cd0 tx=0x7f1190007bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:47.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f119f7fe700 1 -- 172.21.15.164:0/3095166755 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119000fae0 con 0x7f1188004ee0 2020-11-20T11:50:47.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f119f7fe700 1 -- 172.21.15.164:0/3095166755 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119000fc40 con 0x7f1188004ee0 2020-11-20T11:50:47.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11adbb2700 1 -- 172.21.15.164:0/3095166755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a8160d90 con 0x7f1188004ee0 2020-11-20T11:50:47.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f119f7fe700 1 -- 172.21.15.164:0/3095166755 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190014450 con 0x7f1188004ee0 2020-11-20T11:50:47.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.211+0000 7f11adbb2700 1 -- 172.21.15.164:0/3095166755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a81612d0 con 0x7f1188004ee0 2020-11-20T11:50:47.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.212+0000 7f11adbb2700 1 -- 172.21.15.164:0/3095166755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a8069b70 con 0x7f1188004ee0 2020-11-20T11:50:47.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.213+0000 7f119f7fe700 1 -- 172.21.15.164:0/3095166755 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f119001b030 con 0x7f1188004ee0 2020-11-20T11:50:47.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.213+0000 7f119f7fe700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f11840806a0 0x7f1184082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.213+0000 7f119f7fe700 1 -- 172.21.15.164:0/3095166755 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f11900a29a0 con 0x7f1188004ee0 2020-11-20T11:50:47.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.213+0000 7f11a6ffd700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f11840806a0 0x7f1184082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.213+0000 7f11a6ffd700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f11840806a0 0x7f1184082b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1198007760 tx=0x7f1198009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:47.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.216+0000 7f119f7fe700 1 -- 172.21.15.164:0/3095166755 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f11900773b0 con 0x7f1188004ee0 2020-11-20T11:50:47.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.359+0000 7f11adbb2700 1 -- 172.21.15.164:0/3095166755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11a814aac0 con 0x7f1188004ee0 2020-11-20T11:50:47.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.359+0000 7f119f7fe700 1 -- 172.21.15.164:0/3095166755 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f119007a9d0 con 0x7f1188004ee0 2020-11-20T11:50:47.366 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:47.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 -- 172.21.15.164:0/3095166755 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f11840806a0 msgr2=0x7f1184082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f11840806a0 0x7f1184082b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1198007760 tx=0x7f1198009040).stop 2020-11-20T11:50:47.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 -- 172.21.15.164:0/3095166755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 msgr2=0x7f11a80c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f11a80c7bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1190002cd0 tx=0x7f1190007bb0).stop 2020-11-20T11:50:47.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 -- 172.21.15.164:0/3095166755 shutdown_connections 2020-11-20T11:50:47.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f11840806a0 0x7f1184082b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1188004ee0 0x7f11a80c7bd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11a8143df0 0x7f11a8156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 --2- 172.21.15.164:0/3095166755 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11a8152510 0x7f11a8164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.369 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 -- 172.21.15.164:0/3095166755 >> 172.21.15.164:0/3095166755 conn(0x7f11a80683b0 msgr2=0x7f11a80bdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:47.369 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 -- 172.21.15.164:0/3095166755 shutdown_connections 2020-11-20T11:50:47.369 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.361+0000 7f11adbb2700 1 -- 172.21.15.164:0/3095166755 wait complete. 2020-11-20T11:50:47.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.2 2020-11-20T11:50:47.376 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-11-20T11:50:47.488 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.485+0000 7fd723fff700 1 Processor -- start 2020-11-20T11:50:47.489 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.485+0000 7fd723fff700 1 -- start start 2020-11-20T11:50:47.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd723fff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd724150640 0x7fd7240c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd723fff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd7240c2680 0x7fd7240c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd723fff700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7240c3e50 con 0x7fd7241544c0 2020-11-20T11:50:47.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd723fff700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd724151a30 con 0x7fd724150640 2020-11-20T11:50:47.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd723fff700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd724151c60 con 0x7fd7240c2680 2020-11-20T11:50:47.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd722ffd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd724150640 0x7fd7240c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd7227fc700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fd7241544c0 0x7fd7240c1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55466/0 (socket says 172.21.15.164:55466) 2020-11-20T11:50:47.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd7227fc700 1 -- 172.21.15.164:0/3742889953 learned_addr learned my addr 172.21.15.164:0/3742889953 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:47.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd7237fe700 1 --2- 172.21.15.164:0/3742889953 >> v2:172.21.15.188:3300/0 conn(0x7fd7240c2680 0x7fd7240c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd722ffd700 1 -- 172.21.15.164:0/3742889953 >> v2:172.21.15.188:3300/0 conn(0x7fd7240c2680 msgr2=0x7fd7240c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd722ffd700 1 --2- 172.21.15.164:0/3742889953 >> v2:172.21.15.188:3300/0 conn(0x7fd7240c2680 0x7fd7240c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd722ffd700 1 -- 172.21.15.164:0/3742889953 >> v1:172.21.15.164:6789/0 conn(0x7fd7241544c0 legacy=0x7fd7240c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd721ffb700 1 -- 172.21.15.164:0/3742889953 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774194719 0 0) 0x7fd7240c3e50 con 0x7fd7241544c0 2020-11-20T11:50:47.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd722ffd700 1 -- 172.21.15.164:0/3742889953 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7240c40e0 con 0x7fd724150640 2020-11-20T11:50:47.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd7237fe700 1 --2- 172.21.15.164:0/3742889953 >> v2:172.21.15.188:3300/0 conn(0x7fd7240c2680 0x7fd7240c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:47.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd722ffd700 1 --2- 172.21.15.164:0/3742889953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd724150640 0x7fd7240c74e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd724080e80 tx=0x7fd714006e30).ready entity=mon.1 client_cookie=e77c3b7d7c5e2a5c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:47.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd721ffb700 1 -- 172.21.15.164:0/3742889953 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714009840 con 0x7fd724150640 2020-11-20T11:50:47.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd721ffb700 1 -- 172.21.15.164:0/3742889953 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd714000e90 con 0x7fd724150640 2020-11-20T11:50:47.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.486+0000 7fd721ffb700 1 -- 172.21.15.164:0/3742889953 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714009bb0 con 0x7fd724150640 2020-11-20T11:50:47.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.487+0000 7fd723fff700 1 -- 172.21.15.164:0/3742889953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd724150640 msgr2=0x7fd7240c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.487+0000 7fd723fff700 1 --2- 172.21.15.164:0/3742889953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd724150640 0x7fd7240c74e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd724080e80 tx=0x7fd714006e30).stop 2020-11-20T11:50:47.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.487+0000 7fd723fff700 1 -- 172.21.15.164:0/3742889953 shutdown_connections 2020-11-20T11:50:47.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.487+0000 7fd723fff700 1 --2- 172.21.15.164:0/3742889953 >> v2:172.21.15.188:3300/0 conn(0x7fd7240c2680 0x7fd7240c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.487+0000 7fd723fff700 1 --2- 172.21.15.164:0/3742889953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd724150640 0x7fd7240c74e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.487+0000 7fd723fff700 1 -- 172.21.15.164:0/3742889953 >> 172.21.15.164:0/3742889953 conn(0x7fd72407ffb0 msgr2=0x7fd7240803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:47.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.487+0000 7fd723fff700 1 -- 172.21.15.164:0/3742889953 shutdown_connections 2020-11-20T11:50:47.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.487+0000 7fd723fff700 1 -- 172.21.15.164:0/3742889953 wait complete. 2020-11-20T11:50:47.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.488+0000 7fd723fff700 1 Processor -- start 2020-11-20T11:50:47.498 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.488+0000 7fd723fff700 1 -- start start 2020-11-20T11:50:47.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd723fff700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7240c2680 0x7fd7240c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd723fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd724150640 0x7fd7240c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd723fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7241544c0 0x7fd72414c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd723fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd724160290 con 0x7fd724150640 2020-11-20T11:50:47.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd723fff700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7241604c0 con 0x7fd7241544c0 2020-11-20T11:50:47.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd723fff700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd724160760 con 0x7fd7240c2680 2020-11-20T11:50:47.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd7237fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7241544c0 0x7fd72414c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd7237fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7241544c0 0x7fd72414c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45736/0 (socket says 172.21.15.164:45736) 2020-11-20T11:50:47.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd7237fe700 1 -- 172.21.15.164:0/1310613158 learned_addr learned my addr 172.21.15.164:0/1310613158 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:47.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd722ffd700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7240c2680 0x7fd7240c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd7227fc700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd724150640 0x7fd7240c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd7237fe700 1 -- 172.21.15.164:0/1310613158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7240c2680 msgr2=0x7fd7240c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd7237fe700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7240c2680 0x7fd7240c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd7237fe700 1 -- 172.21.15.164:0/1310613158 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd724150640 msgr2=0x7fd7240c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd7237fe700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd724150640 0x7fd7240c2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd7237fe700 1 -- 172.21.15.164:0/1310613158 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724160a00 con 0x7fd7241544c0 2020-11-20T11:50:47.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.489+0000 7fd7237fe700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7241544c0 0x7fd72414c9b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fd71c00cb80 tx=0x7fd71c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:47.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.490+0000 7fd70affd700 1 -- 172.21.15.164:0/1310613158 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c00a9d0 con 0x7fd7241544c0 2020-11-20T11:50:47.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.490+0000 7fd70affd700 1 -- 172.21.15.164:0/1310613158 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c00ab30 con 0x7fd7241544c0 2020-11-20T11:50:47.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.490+0000 7fd723fff700 1 -- 172.21.15.164:0/1310613158 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd724160ca0 con 0x7fd7241544c0 2020-11-20T11:50:47.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.490+0000 7fd70affd700 1 -- 172.21.15.164:0/1310613158 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c011410 con 0x7fd7241544c0 2020-11-20T11:50:47.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.490+0000 7fd723fff700 1 -- 172.21.15.164:0/1310613158 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7240c3110 con 0x7fd7241544c0 2020-11-20T11:50:47.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.491+0000 7fd723fff700 1 -- 172.21.15.164:0/1310613158 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd724161100 con 0x7fd7241544c0 2020-11-20T11:50:47.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.491+0000 7fd70affd700 1 -- 172.21.15.164:0/1310613158 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd71c011800 con 0x7fd7241544c0 2020-11-20T11:50:47.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.492+0000 7fd70affd700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7000806a0 0x7fd700082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.492+0000 7fd70affd700 1 -- 172.21.15.164:0/1310613158 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd71c0a2fa0 con 0x7fd7241544c0 2020-11-20T11:50:47.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.492+0000 7fd722ffd700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7000806a0 0x7fd700082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.492+0000 7fd722ffd700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7000806a0 0x7fd700082b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd714006e70 tx=0x7fd714015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:47.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.495+0000 7fd70affd700 1 -- 172.21.15.164:0/1310613158 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd71c0779b0 con 0x7fd7241544c0 2020-11-20T11:50:47.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.637+0000 7fd723fff700 1 -- 172.21.15.164:0/1310613158 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd724044fa0 con 0x7fd7241544c0 2020-11-20T11:50:47.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.637+0000 7fd70affd700 1 -- 172.21.15.164:0/1310613158 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd71c07afd0 con 0x7fd7241544c0 2020-11-20T11:50:47.641 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:47.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 -- 172.21.15.164:0/1310613158 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7000806a0 msgr2=0x7fd700082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7000806a0 0x7fd700082b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd714006e70 tx=0x7fd714015000).stop 2020-11-20T11:50:47.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 -- 172.21.15.164:0/1310613158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7241544c0 msgr2=0x7fd72414c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7241544c0 0x7fd72414c9b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fd71c00cb80 tx=0x7fd71c008040).stop 2020-11-20T11:50:47.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 -- 172.21.15.164:0/1310613158 shutdown_connections 2020-11-20T11:50:47.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7000806a0 0x7fd700082b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7241544c0 0x7fd72414c9b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7240c2680 0x7fd7240c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 --2- 172.21.15.164:0/1310613158 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd724150640 0x7fd7240c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 -- 172.21.15.164:0/1310613158 >> 172.21.15.164:0/1310613158 conn(0x7fd72407ffb0 msgr2=0x7fd7240c1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:47.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 -- 172.21.15.164:0/1310613158 shutdown_connections 2020-11-20T11:50:47.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.639+0000 7fd723fff700 1 -- 172.21.15.164:0/1310613158 wait complete. 2020-11-20T11:50:47.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.3 2020-11-20T11:50:47.654 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2020-11-20T11:50:47.765 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.762+0000 7ff580420700 1 Processor -- start 2020-11-20T11:50:47.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.762+0000 7ff580420700 1 -- start start 2020-11-20T11:50:47.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff580420700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff5780bccf0 0x7ff5780c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff580420700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5781555a0 con 0x7ff5780bf680 2020-11-20T11:50:47.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff580420700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5781517d0 con 0x7ff5780c4470 2020-11-20T11:50:47.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff580420700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff578151a70 con 0x7ff5780bccf0 2020-11-20T11:50:47.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57e9bd700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff5780bf680 0x7ff5781504b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55482/0 (socket says 172.21.15.164:55482) 2020-11-20T11:50:47.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57e9bd700 1 -- 172.21.15.164:0/2601373605 learned_addr learned my addr 172.21.15.164:0/2601373605 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:47.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607589015 0 0) 0x7ff5781555a0 con 0x7ff5780bf680 2020-11-20T11:50:47.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff560003280 con 0x7ff5780bf680 2020-11-20T11:50:47.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d9bb700 1 --2- 172.21.15.164:0/2601373605 >> v2:172.21.15.188:3300/0 conn(0x7ff5780bccf0 0x7ff5780c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3649806134 0 0) 0x7ff560003280 con 0x7ff5780bf680 2020-11-20T11:50:47.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 >> v2:172.21.15.188:3300/0 conn(0x7ff5780bccf0 msgr2=0x7ff5780c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:47.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 --2- 172.21.15.164:0/2601373605 >> v2:172.21.15.188:3300/0 conn(0x7ff5780bccf0 0x7ff5780c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 >> v1:172.21.15.188:6789/0 conn(0x7ff5780c4470 legacy=0x7ff5780c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578151d10 con 0x7ff5780bf680 2020-11-20T11:50:47.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7ff5700018a0 con 0x7ff5780bf680 2020-11-20T11:50:47.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 >> v1:172.21.15.164:6789/0 conn(0x7ff5780bf680 legacy=0x7ff5781504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 --2- 172.21.15.164:0/2601373605 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5600037c0 0x7ff560003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 --2- 172.21.15.164:0/2601373605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff560004520 0x7ff5600049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 --2- 172.21.15.164:0/2601373605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff560004e90 0x7ff56000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff578151a70 con 0x7ff5600037c0 2020-11-20T11:50:47.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff560005340 con 0x7ff560004520 2020-11-20T11:50:47.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.763+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56000bc60 con 0x7ff560004e90 2020-11-20T11:50:47.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57d9bb700 1 --2- 172.21.15.164:0/2601373605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff560004520 0x7ff5600049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57e9bd700 1 --2- 172.21.15.164:0/2601373605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff560004e90 0x7ff56000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57d9bb700 1 -- 172.21.15.164:0/2601373605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff560004e90 msgr2=0x7ff56000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:47.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57d9bb700 1 --2- 172.21.15.164:0/2601373605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff560004e90 0x7ff56000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57d9bb700 1 -- 172.21.15.164:0/2601373605 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5600037c0 msgr2=0x7ff560003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:47.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57d9bb700 1 --2- 172.21.15.164:0/2601373605 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5600037c0 0x7ff560003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:47.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57e9bd700 1 -- 172.21.15.164:0/2601373605 reap_dead start 2020-11-20T11:50:47.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57d9bb700 1 -- 172.21.15.164:0/2601373605 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560003280 con 0x7ff560004520 2020-11-20T11:50:47.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57d9bb700 1 --2- 172.21.15.164:0/2601373605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff560004520 0x7ff5600049a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff568006fd0 tx=0x7ff568006e30).ready entity=mon.1 client_cookie=7ac59c6b9c2c4166 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:47.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568016070 con 0x7ff560004520 2020-11-20T11:50:47.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56800b370 con 0x7ff560004520 2020-11-20T11:50:47.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff57d1ba700 1 -- 172.21.15.164:0/2601373605 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56800ebe0 con 0x7ff560004520 2020-11-20T11:50:47.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff580420700 1 -- 172.21.15.164:0/2601373605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff560004520 msgr2=0x7ff5600049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff580420700 1 --2- 172.21.15.164:0/2601373605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff560004520 0x7ff5600049a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff568006fd0 tx=0x7ff568006e30).stop 2020-11-20T11:50:47.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff580420700 1 -- 172.21.15.164:0/2601373605 shutdown_connections 2020-11-20T11:50:47.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.764+0000 7ff580420700 1 --2- 172.21.15.164:0/2601373605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff560004520 0x7ff5600049a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.765+0000 7ff580420700 1 -- 172.21.15.164:0/2601373605 >> 172.21.15.164:0/2601373605 conn(0x7ff5780683b0 msgr2=0x7ff578061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:47.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.765+0000 7ff580420700 1 -- 172.21.15.164:0/2601373605 shutdown_connections 2020-11-20T11:50:47.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.765+0000 7ff580420700 1 -- 172.21.15.164:0/2601373605 wait complete. 2020-11-20T11:50:47.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff580420700 1 Processor -- start 2020-11-20T11:50:47.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff580420700 1 -- start start 2020-11-20T11:50:47.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff580420700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff560004520 0x7ff578156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff580420700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff578112230 0x7ff578160d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff580420700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff578152da0 0x7ff57814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff580420700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5781554f0 con 0x7ff578112230 2020-11-20T11:50:47.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff580420700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5781611f0 con 0x7ff578152da0 2020-11-20T11:50:47.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff580420700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff578112af0 con 0x7ff560004520 2020-11-20T11:50:47.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff57e9bd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff578152da0 0x7ff57814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff57e9bd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff578152da0 0x7ff57814bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45754/0 (socket says 172.21.15.164:45754) 2020-11-20T11:50:47.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.766+0000 7ff57e9bd700 1 -- 172.21.15.164:0/3530509416 learned_addr learned my addr 172.21.15.164:0/3530509416 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:47.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff57e9bd700 1 -- 172.21.15.164:0/3530509416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff560004520 msgr2=0x7ff578156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff57e1bc700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff560004520 0x7ff578156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff57e9bd700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff560004520 0x7ff578156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff57e9bd700 1 -- 172.21.15.164:0/3530509416 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff578112230 msgr2=0x7ff578160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.798 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff57d9bb700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff578112230 0x7ff578160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.798 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff57e9bd700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff578112230 0x7ff578160d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.798 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff57e9bd700 1 -- 172.21.15.164:0/3530509416 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578112850 con 0x7ff578152da0 2020-11-20T11:50:47.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff57e1bc700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff560004520 0x7ff578156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:47.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff57e9bd700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff578152da0 0x7ff57814bab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff5700077b0 tx=0x7ff578151ea0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:47.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff5667fc700 1 -- 172.21.15.164:0/3530509416 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57000fcd0 con 0x7ff578152da0 2020-11-20T11:50:47.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff5667fc700 1 -- 172.21.15.164:0/3530509416 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57000fe30 con 0x7ff578152da0 2020-11-20T11:50:47.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff5667fc700 1 -- 172.21.15.164:0/3530509416 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570015660 con 0x7ff578152da0 2020-11-20T11:50:47.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff580420700 1 -- 172.21.15.164:0/3530509416 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5781556d0 con 0x7ff578152da0 2020-11-20T11:50:47.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.767+0000 7ff580420700 1 -- 172.21.15.164:0/3530509416 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff578155c10 con 0x7ff578152da0 2020-11-20T11:50:47.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.768+0000 7ff580420700 1 -- 172.21.15.164:0/3530509416 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff578112610 con 0x7ff578152da0 2020-11-20T11:50:47.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.769+0000 7ff5667fc700 1 -- 172.21.15.164:0/3530509416 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff57001f070 con 0x7ff578152da0 2020-11-20T11:50:47.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.769+0000 7ff5667fc700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff5500806a0 0x7ff550082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:47.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.769+0000 7ff5667fc700 1 -- 172.21.15.164:0/3530509416 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff5700a25b0 con 0x7ff578152da0 2020-11-20T11:50:47.805 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.769+0000 7ff57e1bc700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff5500806a0 0x7ff550082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:47.805 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.770+0000 7ff57e1bc700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff5500806a0 0x7ff550082b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ff5740014d0 tx=0x7ff574009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:47.805 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.772+0000 7ff5667fc700 1 -- 172.21.15.164:0/3530509416 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff570076f60 con 0x7ff578152da0 2020-11-20T11:50:47.915 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.911+0000 7ff580420700 1 -- 172.21.15.164:0/3530509416 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff578112610 con 0x7ff578152da0 2020-11-20T11:50:47.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.911+0000 7ff5667fc700 1 -- 172.21.15.164:0/3530509416 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff578112610 con 0x7ff578152da0 2020-11-20T11:50:47.917 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:47.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 -- 172.21.15.164:0/3530509416 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff5500806a0 msgr2=0x7ff550082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff5500806a0 0x7ff550082b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ff5740014d0 tx=0x7ff574009040).stop 2020-11-20T11:50:47.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 -- 172.21.15.164:0/3530509416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff578152da0 msgr2=0x7ff57814bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:47.922 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff578152da0 0x7ff57814bab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff5700077b0 tx=0x7ff578151ea0).stop 2020-11-20T11:50:47.922 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 -- 172.21.15.164:0/3530509416 shutdown_connections 2020-11-20T11:50:47.924 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff5500806a0 0x7ff550082b60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff578152da0 0x7ff57814bab0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff560004520 0x7ff578156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 --2- 172.21.15.164:0/3530509416 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff578112230 0x7ff578160d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:47.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 -- 172.21.15.164:0/3530509416 >> 172.21.15.164:0/3530509416 conn(0x7ff5780683b0 msgr2=0x7ff578061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:47.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 -- 172.21.15.164:0/3530509416 shutdown_connections 2020-11-20T11:50:47.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:47.913+0000 7ff580420700 1 -- 172.21.15.164:0/3530509416 wait complete. 2020-11-20T11:50:47.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.4 2020-11-20T11:50:47.931 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2020-11-20T11:50:48.093 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.082+0000 7fc0b969f700 1 Processor -- start 2020-11-20T11:50:48.093 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.082+0000 7fc0b969f700 1 -- start start 2020-11-20T11:50:48.094 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.083+0000 7fc0b969f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc0b4151ec0 0x7fc0b40c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.094 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.083+0000 7fc0b969f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b4155070 con 0x7fc0b40c44a0 2020-11-20T11:50:48.094 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.083+0000 7fc0b969f700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b4155310 con 0x7fc0b4068140 2020-11-20T11:50:48.094 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.083+0000 7fc0b969f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b41555b0 con 0x7fc0b4151ec0 2020-11-20T11:50:48.094 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.083+0000 7fc0b2ffd700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc0b40c44a0 0x7fc0b41547a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55498/0 (socket says 172.21.15.164:55498) 2020-11-20T11:50:48.095 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.083+0000 7fc0b2ffd700 1 -- 172.21.15.164:0/1800658139 learned_addr learned my addr 172.21.15.164:0/1800658139 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:48.095 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0abfff700 1 --2- 172.21.15.164:0/1800658139 >> v2:172.21.15.36:3300/0 conn(0x7fc0b4151ec0 0x7fc0b40c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.095 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238313201 0 0) 0x7fc0b4155070 con 0x7fc0b40c44a0 2020-11-20T11:50:48.095 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc094003280 con 0x7fc0b40c44a0 2020-11-20T11:50:48.095 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053219687 0 0) 0x7fc0b4155310 con 0x7fc0b4068140 2020-11-20T11:50:48.096 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b4155070 con 0x7fc0b4068140 2020-11-20T11:50:48.096 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3785160272 0 0) 0x7fc094003280 con 0x7fc0b40c44a0 2020-11-20T11:50:48.096 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 >> v2:172.21.15.36:3300/0 conn(0x7fc0b4151ec0 msgr2=0x7fc0b40c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:48.096 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 --2- 172.21.15.164:0/1800658139 >> v2:172.21.15.36:3300/0 conn(0x7fc0b4151ec0 0x7fc0b40c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.096 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 >> v1:172.21.15.188:6789/0 conn(0x7fc0b4068140 legacy=0x7fc0b40c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.097 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b41514e0 con 0x7fc0b40c44a0 2020-11-20T11:50:48.097 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fc0a4001520 con 0x7fc0b40c44a0 2020-11-20T11:50:48.097 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 >> v1:172.21.15.164:6789/0 conn(0x7fc0b40c44a0 legacy=0x7fc0b41547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.097 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094003950 0x7fc094003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.097 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094004520 0x7fc0940049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.098 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc094004e90 0x7fc09400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.098 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b41555b0 con 0x7fc094004520 2020-11-20T11:50:48.098 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09400bc60 con 0x7fc094003950 2020-11-20T11:50:48.098 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09400bda0 con 0x7fc094004e90 2020-11-20T11:50:48.098 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b2ffd700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094003950 0x7fc094003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.099 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b37fe700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc094004e90 0x7fc09400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.099 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0abfff700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094004520 0x7fc0940049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.099 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b2ffd700 1 -- 172.21.15.164:0/1800658139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc094004e90 msgr2=0x7fc09400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:48.099 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b2ffd700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc094004e90 0x7fc09400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.099 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b2ffd700 1 -- 172.21.15.164:0/1800658139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094004520 msgr2=0x7fc0940049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:48.100 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b2ffd700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094004520 0x7fc0940049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.100 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b37fe700 1 -- 172.21.15.164:0/1800658139 reap_dead start 2020-11-20T11:50:48.100 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b2ffd700 1 -- 172.21.15.164:0/1800658139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094003280 con 0x7fc094003950 2020-11-20T11:50:48.100 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0abfff700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094004520 0x7fc0940049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:48.100 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b2ffd700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094003950 0x7fc094003d50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fc0a400c420 tx=0x7fc0b4151670).ready entity=mon.1 client_cookie=cd2f6a0b92fbecc8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.100 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.084+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40070d0 con 0x7fc094003950 2020-11-20T11:50:48.101 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.085+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a4007230 con 0x7fc094003950 2020-11-20T11:50:48.101 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.085+0000 7fc0b27fc700 1 -- 172.21.15.164:0/1800658139 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4005630 con 0x7fc094003950 2020-11-20T11:50:48.101 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.085+0000 7fc0b969f700 1 -- 172.21.15.164:0/1800658139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094003950 msgr2=0x7fc094003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.101 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.085+0000 7fc0b969f700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094003950 0x7fc094003d50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fc0a400c420 tx=0x7fc0b4151670).stop 2020-11-20T11:50:48.102 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.085+0000 7fc0b969f700 1 -- 172.21.15.164:0/1800658139 shutdown_connections 2020-11-20T11:50:48.102 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.085+0000 7fc0b969f700 1 --2- 172.21.15.164:0/1800658139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc094003950 0x7fc094003d50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.102 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.085+0000 7fc0b969f700 1 -- 172.21.15.164:0/1800658139 >> 172.21.15.164:0/1800658139 conn(0x7fc0b4061580 msgr2=0x7fc0b40678e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:48.102 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.085+0000 7fc0b969f700 1 -- 172.21.15.164:0/1800658139 shutdown_connections 2020-11-20T11:50:48.102 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.085+0000 7fc0b969f700 1 -- 172.21.15.164:0/1800658139 wait complete. 2020-11-20T11:50:48.103 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.086+0000 7fc0b969f700 1 Processor -- start 2020-11-20T11:50:48.103 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.086+0000 7fc0b969f700 1 -- start start 2020-11-20T11:50:48.103 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0b969f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094003950 0x7fc0b4157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.103 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0b969f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0b4160820 0x7fc0b4164560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.103 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0b969f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0b414ee20 0x7fc0b4156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.103 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0b969f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4160ca0 con 0x7fc094003950 2020-11-20T11:50:48.104 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0b969f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b414c510 con 0x7fc0b4160820 2020-11-20T11:50:48.104 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0b969f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4160ee0 con 0x7fc0b414ee20 2020-11-20T11:50:48.104 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0abfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0b4160820 0x7fc0b4164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.104 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0abfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0b4160820 0x7fc0b4164560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45770/0 (socket says 172.21.15.164:45770) 2020-11-20T11:50:48.104 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0abfff700 1 -- 172.21.15.164:0/4183564639 learned_addr learned my addr 172.21.15.164:0/4183564639 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:48.105 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0b2ffd700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094003950 0x7fc0b4157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.105 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0b37fe700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0b414ee20 0x7fc0b4156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.105 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0abfff700 1 -- 172.21.15.164:0/4183564639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0b414ee20 msgr2=0x7fc0b4156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.105 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0abfff700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0b414ee20 0x7fc0b4156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.105 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0abfff700 1 -- 172.21.15.164:0/4183564639 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094003950 msgr2=0x7fc0b4157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.106 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0abfff700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094003950 0x7fc0b4157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.106 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0abfff700 1 -- 172.21.15.164:0/4183564639 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4161180 con 0x7fc0b4160820 2020-11-20T11:50:48.106 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0b2ffd700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094003950 0x7fc0b4157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:48.106 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0abfff700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0b4160820 0x7fc0b4164560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fc09c0109a0 tx=0x7fc09c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.106 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0aaffd700 1 -- 172.21.15.164:0/4183564639 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c010e90 con 0x7fc0b4160820 2020-11-20T11:50:48.107 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0aaffd700 1 -- 172.21.15.164:0/4183564639 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c00e8d0 con 0x7fc0b4160820 2020-11-20T11:50:48.107 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0b969f700 1 -- 172.21.15.164:0/4183564639 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b4161420 con 0x7fc0b4160820 2020-11-20T11:50:48.107 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.087+0000 7fc0aaffd700 1 -- 172.21.15.164:0/4183564639 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c00ec50 con 0x7fc0b4160820 2020-11-20T11:50:48.107 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.088+0000 7fc0b969f700 1 -- 172.21.15.164:0/4183564639 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b4163e20 con 0x7fc0b4160820 2020-11-20T11:50:48.107 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.088+0000 7fc0b969f700 1 -- 172.21.15.164:0/4183564639 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b40be700 con 0x7fc0b4160820 2020-11-20T11:50:48.108 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.089+0000 7fc0aaffd700 1 -- 172.21.15.164:0/4183564639 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc09c00edb0 con 0x7fc0b4160820 2020-11-20T11:50:48.108 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.089+0000 7fc0aaffd700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc0900806a0 0x7fc090082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.108 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.089+0000 7fc0aaffd700 1 -- 172.21.15.164:0/4183564639 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc09c0a2c50 con 0x7fc0b4160820 2020-11-20T11:50:48.108 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.090+0000 7fc0b2ffd700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc0900806a0 0x7fc090082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.109 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.090+0000 7fc0b2ffd700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc0900806a0 0x7fc090082b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc0a4007900 tx=0x7fc0a4013000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.109 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.093+0000 7fc0aaffd700 1 -- 172.21.15.164:0/4183564639 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc09c077660 con 0x7fc0b4160820 2020-11-20T11:50:48.237 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.233+0000 7fc0b969f700 1 -- 172.21.15.164:0/4183564639 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc0b4069b70 con 0x7fc0b4160820 2020-11-20T11:50:48.238 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.234+0000 7fc0aaffd700 1 -- 172.21.15.164:0/4183564639 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc09c07ac80 con 0x7fc0b4160820 2020-11-20T11:50:48.238 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:48.239 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.235+0000 7fc0b969f700 1 -- 172.21.15.164:0/4183564639 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc0900806a0 msgr2=0x7fc090082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.239 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.235+0000 7fc0b969f700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc0900806a0 0x7fc090082b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc0a4007900 tx=0x7fc0a4013000).stop 2020-11-20T11:50:48.240 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.235+0000 7fc0b969f700 1 -- 172.21.15.164:0/4183564639 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0b4160820 msgr2=0x7fc0b4164560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.240 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.235+0000 7fc0b969f700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0b4160820 0x7fc0b4164560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fc09c0109a0 tx=0x7fc09c008040).stop 2020-11-20T11:50:48.240 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.235+0000 7fc0b969f700 1 -- 172.21.15.164:0/4183564639 shutdown_connections 2020-11-20T11:50:48.240 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.235+0000 7fc0b969f700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc0900806a0 0x7fc090082b60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.241 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.235+0000 7fc0b969f700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0b414ee20 0x7fc0b4156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.241 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.235+0000 7fc0b969f700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc094003950 0x7fc0b4157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.241 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.235+0000 7fc0b969f700 1 --2- 172.21.15.164:0/4183564639 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0b4160820 0x7fc0b4164560 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.241 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.235+0000 7fc0b969f700 1 -- 172.21.15.164:0/4183564639 >> 172.21.15.164:0/4183564639 conn(0x7fc0b4061580 msgr2=0x7fc0b40c5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:48.241 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.236+0000 7fc0b969f700 1 -- 172.21.15.164:0/4183564639 shutdown_connections 2020-11-20T11:50:48.242 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.236+0000 7fc0b969f700 1 -- 172.21.15.164:0/4183564639 wait complete. 2020-11-20T11:50:48.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.5 2020-11-20T11:50:48.256 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2020-11-20T11:50:48.407 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.404+0000 7f1861ab9700 1 Processor -- start 2020-11-20T11:50:48.409 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.404+0000 7f1861ab9700 1 -- start start 2020-11-20T11:50:48.417 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f1861ab9700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f185c0c45e0 0x7f185c0bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.417 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f1861ab9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c0c12b0 con 0x7f185c0c4200 2020-11-20T11:50:48.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f1861ab9700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c151780 con 0x7f185c0bccf0 2020-11-20T11:50:48.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f1861ab9700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0c4a30 con 0x7f185c0c45e0 2020-11-20T11:50:48.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185b7fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f185c0c4200 0x7f185c150fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55518/0 (socket says 172.21.15.164:55518) 2020-11-20T11:50:48.420 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185b7fe700 1 -- 172.21.15.164:0/159387077 learned_addr learned my addr 172.21.15.164:0/159387077 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:48.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414487024 0 0) 0x7f185c0c12b0 con 0x7f185c0c4200 2020-11-20T11:50:48.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185bfff700 1 --2- 172.21.15.164:0/159387077 >> v2:172.21.15.188:3300/0 conn(0x7f185c0c45e0 0x7f185c0bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.421 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1848003280 con 0x7f185c0c4200 2020-11-20T11:50:48.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 546229596 0 0) 0x7f1848003280 con 0x7f185c0c4200 2020-11-20T11:50:48.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 >> v2:172.21.15.188:3300/0 conn(0x7f185c0c45e0 msgr2=0x7f185c0bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:48.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 --2- 172.21.15.164:0/159387077 >> v2:172.21.15.188:3300/0 conn(0x7f185c0c45e0 0x7f185c0bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 >> v1:172.21.15.188:6789/0 conn(0x7f185c0bccf0 legacy=0x7f185c0c0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.422 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c151a20 con 0x7f185c0c4200 2020-11-20T11:50:48.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7f1850001520 con 0x7f185c0c4200 2020-11-20T11:50:48.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 >> v1:172.21.15.164:6789/0 conn(0x7f185c0c4200 legacy=0x7f185c150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 --2- 172.21.15.164:0/159387077 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1848003810 0x7f1848003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.423 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 --2- 172.21.15.164:0/159387077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1848004520 0x7f18480049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 --2- 172.21.15.164:0/159387077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1848004e90 0x7f184800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0c4a30 con 0x7f1848003810 2020-11-20T11:50:48.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1848005340 con 0x7f1848004520 2020-11-20T11:50:48.424 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.405+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184800bc60 con 0x7f1848004e90 2020-11-20T11:50:48.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185affd700 1 --2- 172.21.15.164:0/159387077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1848004520 0x7f18480049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185bfff700 1 --2- 172.21.15.164:0/159387077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1848004e90 0x7f184800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.426 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185affd700 1 -- 172.21.15.164:0/159387077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1848004e90 msgr2=0x7f184800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:48.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185affd700 1 --2- 172.21.15.164:0/159387077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1848004e90 0x7f184800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.427 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185affd700 1 -- 172.21.15.164:0/159387077 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1848003810 msgr2=0x7f1848003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:48.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185affd700 1 --2- 172.21.15.164:0/159387077 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1848003810 0x7f1848003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:50:48.428 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185affd700 1 -- 172.21.15.164:0/159387077 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848003280 con 0x7f1848004520 2020-11-20T11:50:48.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185bfff700 1 -- 172.21.15.164:0/159387077 reap_dead start 2020-11-20T11:50:48.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185affd700 1 --2- 172.21.15.164:0/159387077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1848004520 0x7f18480049a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f184c001960 tx=0x7f184c007bd0).ready entity=mon.1 client_cookie=20efea1b4a2621e3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.429 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c007020 con 0x7f1848004520 2020-11-20T11:50:48.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c007180 con 0x7f1848004520 2020-11-20T11:50:48.430 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f185a7fc700 1 -- 172.21.15.164:0/159387077 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c00c860 con 0x7f1848004520 2020-11-20T11:50:48.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.406+0000 7f1861ab9700 1 -- 172.21.15.164:0/159387077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1848004520 msgr2=0x7f18480049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.407+0000 7f1861ab9700 1 --2- 172.21.15.164:0/159387077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1848004520 0x7f18480049a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f184c001960 tx=0x7f184c007bd0).stop 2020-11-20T11:50:48.431 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.407+0000 7f1861ab9700 1 -- 172.21.15.164:0/159387077 shutdown_connections 2020-11-20T11:50:48.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.407+0000 7f1861ab9700 1 --2- 172.21.15.164:0/159387077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1848004520 0x7f18480049a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.432 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.407+0000 7f1861ab9700 1 -- 172.21.15.164:0/159387077 >> 172.21.15.164:0/159387077 conn(0x7f185c0678e0 msgr2=0x7f185c067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:48.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.407+0000 7f1861ab9700 1 -- 172.21.15.164:0/159387077 shutdown_connections 2020-11-20T11:50:48.433 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.407+0000 7f1861ab9700 1 -- 172.21.15.164:0/159387077 wait complete. 2020-11-20T11:50:48.434 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.408+0000 7f1861ab9700 1 Processor -- start 2020-11-20T11:50:48.434 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.408+0000 7f1861ab9700 1 -- start start 2020-11-20T11:50:48.434 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f1861ab9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1848004520 0x7f185c0bd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f1861ab9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c1582f0 0x7f185c146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.435 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f1861ab9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f185c0bd8e0 0x7f185c146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f1861ab9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c14e590 con 0x7f1848004520 2020-11-20T11:50:48.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f1861ab9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c14e210 con 0x7f185c1582f0 2020-11-20T11:50:48.436 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f1861ab9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c163f70 con 0x7f185c0bd8e0 2020-11-20T11:50:48.437 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185affd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c1582f0 0x7f185c146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.437 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185affd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c1582f0 0x7f185c146950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45792/0 (socket says 172.21.15.164:45792) 2020-11-20T11:50:48.438 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185affd700 1 -- 172.21.15.164:0/1916163077 learned_addr learned my addr 172.21.15.164:0/1916163077 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:48.438 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185bfff700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f185c0bd8e0 0x7f185c146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.438 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185b7fe700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1848004520 0x7f185c0bd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.439 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185affd700 1 -- 172.21.15.164:0/1916163077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f185c0bd8e0 msgr2=0x7f185c146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.439 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185affd700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f185c0bd8e0 0x7f185c146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.439 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185affd700 1 -- 172.21.15.164:0/1916163077 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1848004520 msgr2=0x7f185c0bd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.440 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185affd700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1848004520 0x7f185c0bd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.440 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185affd700 1 -- 172.21.15.164:0/1916163077 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c164210 con 0x7f185c1582f0 2020-11-20T11:50:48.441 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f185affd700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c1582f0 0x7f185c146950 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f184c00c3c0 tx=0x7f184c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.441 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f183b7fe700 1 -- 172.21.15.164:0/1916163077 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c013840 con 0x7f185c1582f0 2020-11-20T11:50:48.441 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f183b7fe700 1 -- 172.21.15.164:0/1916163077 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c0139a0 con 0x7f185c1582f0 2020-11-20T11:50:48.442 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f1861ab9700 1 -- 172.21.15.164:0/1916163077 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c1644b0 con 0x7f185c1582f0 2020-11-20T11:50:48.442 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f183b7fe700 1 -- 172.21.15.164:0/1916163077 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c013d60 con 0x7f185c1582f0 2020-11-20T11:50:48.442 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.409+0000 7f1861ab9700 1 -- 172.21.15.164:0/1916163077 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c1649f0 con 0x7f185c1582f0 2020-11-20T11:50:48.442 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.410+0000 7f1861ab9700 1 -- 172.21.15.164:0/1916163077 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c14e210 con 0x7f185c1582f0 2020-11-20T11:50:48.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.411+0000 7f183b7fe700 1 -- 172.21.15.164:0/1916163077 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f184c025020 con 0x7f185c1582f0 2020-11-20T11:50:48.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.411+0000 7f183b7fe700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1834080670 0x7f1834082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.411+0000 7f183b7fe700 1 -- 172.21.15.164:0/1916163077 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f184c0a3bb0 con 0x7f185c1582f0 2020-11-20T11:50:48.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.411+0000 7f185b7fe700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1834080670 0x7f1834082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.443 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.412+0000 7f185b7fe700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1834080670 0x7f1834082b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f18500013f0 tx=0x7f1850009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.444 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.415+0000 7f183b7fe700 1 -- 172.21.15.164:0/1916163077 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f184c078540 con 0x7f185c1582f0 2020-11-20T11:50:48.557 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.553+0000 7f1861ab9700 1 -- 172.21.15.164:0/1916163077 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f185c069b70 con 0x7f185c1582f0 2020-11-20T11:50:48.558 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.554+0000 7f183b7fe700 1 -- 172.21.15.164:0/1916163077 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f184c007760 con 0x7f185c1582f0 2020-11-20T11:50:48.558 INFO:teuthology.orchestra.run.smithi164.stdout:73014444037 2020-11-20T11:50:48.559 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 -- 172.21.15.164:0/1916163077 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1834080670 msgr2=0x7f1834082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.560 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1834080670 0x7f1834082b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f18500013f0 tx=0x7f1850009040).stop 2020-11-20T11:50:48.560 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 -- 172.21.15.164:0/1916163077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c1582f0 msgr2=0x7f185c146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.560 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c1582f0 0x7f185c146950 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f184c00c3c0 tx=0x7f184c015000).stop 2020-11-20T11:50:48.560 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 -- 172.21.15.164:0/1916163077 shutdown_connections 2020-11-20T11:50:48.561 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f1834080670 0x7f1834082b30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.561 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f185c0bd8e0 0x7f185c146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.561 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1848004520 0x7f185c0bd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.561 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 --2- 172.21.15.164:0/1916163077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c1582f0 0x7f185c146950 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.561 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 -- 172.21.15.164:0/1916163077 >> 172.21.15.164:0/1916163077 conn(0x7f185c0678e0 msgr2=0x7f185c067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:48.562 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 -- 172.21.15.164:0/1916163077 shutdown_connections 2020-11-20T11:50:48.562 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.555+0000 7f1861ab9700 1 -- 172.21.15.164:0/1916163077 wait complete. 2020-11-20T11:50:48.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444037 for osd.6 2020-11-20T11:50:48.572 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2020-11-20T11:50:48.689 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.685+0000 7fa525b8a700 1 Processor -- start 2020-11-20T11:50:48.690 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.686+0000 7fa525b8a700 1 -- start start 2020-11-20T11:50:48.693 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.686+0000 7fa525b8a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5200c12b0 con 0x7fa5200c4200 2020-11-20T11:50:48.693 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.686+0000 7fa525b8a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa520151780 con 0x7fa5200bccf0 2020-11-20T11:50:48.694 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.686+0000 7fa525b8a700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa520151a20 con 0x7fa5200c45e0 2020-11-20T11:50:48.694 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.686+0000 7fa51effd700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fa5200bccf0 0x7fa5200c0ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55542/0 (socket says 172.21.15.164:55542) 2020-11-20T11:50:48.694 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51effd700 1 -- 172.21.15.164:0/1470217739 learned_addr learned my addr 172.21.15.164:0/1470217739 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:48.694 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483686310 0 0) 0x7fa520151780 con 0x7fa5200bccf0 2020-11-20T11:50:48.694 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c003280 con 0x7fa5200bccf0 2020-11-20T11:50:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363139164 0 0) 0x7fa520151a20 con 0x7fa5200c45e0 2020-11-20T11:50:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa520151780 con 0x7fa5200c45e0 2020-11-20T11:50:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2441503655 0 0) 0x7fa50c003280 con 0x7fa5200bccf0 2020-11-20T11:50:48.695 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 >> v1:172.21.15.188:6789/0 conn(0x7fa5200c45e0 legacy=0x7fa5200bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 >> v1:172.21.15.36:6789/0 conn(0x7fa5200c4200 legacy=0x7fa520150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520151cc0 con 0x7fa5200bccf0 2020-11-20T11:50:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fa514001520 con 0x7fa5200bccf0 2020-11-20T11:50:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 >> v1:172.21.15.164:6789/0 conn(0x7fa5200bccf0 legacy=0x7fa5200c0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.696 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa50c003930 0x7fa50c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.697 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004520 0x7fa50c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.697 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50c004e90 0x7fa50c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.697 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0053c0 con 0x7fa50c004520 2020-11-20T11:50:48.697 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c00bc60 con 0x7fa50c004e90 2020-11-20T11:50:48.697 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c00be20 con 0x7fa50c003930 2020-11-20T11:50:48.698 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51ffff700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50c004e90 0x7fa50c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.698 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51f7fe700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa50c003930 0x7fa50c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.698 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51effd700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004520 0x7fa50c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.698 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51ffff700 1 -- 172.21.15.164:0/1470217739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa50c003930 msgr2=0x7fa50c003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:48.698 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.687+0000 7fa51ffff700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa50c003930 0x7fa50c003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.699 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa51ffff700 1 -- 172.21.15.164:0/1470217739 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004520 msgr2=0x7fa50c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:48.699 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa51ffff700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004520 0x7fa50c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.699 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa51ffff700 1 -- 172.21.15.164:0/1470217739 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c003280 con 0x7fa50c004e90 2020-11-20T11:50:48.699 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa51effd700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004520 0x7fa50c0049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:48.699 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa51ffff700 1 -- 172.21.15.164:0/1470217739 reap_dead start 2020-11-20T11:50:48.700 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa51ffff700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50c004e90 0x7fa50c00b770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa518002070 tx=0x7fa518007f30).ready entity=mon.1 client_cookie=2a0bc53bad552420 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.700 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51800cbf0 con 0x7fa50c004e90 2020-11-20T11:50:48.700 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51800cd50 con 0x7fa50c004e90 2020-11-20T11:50:48.700 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa51e7fc700 1 -- 172.21.15.164:0/1470217739 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518012600 con 0x7fa50c004e90 2020-11-20T11:50:48.700 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa525b8a700 1 -- 172.21.15.164:0/1470217739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50c004e90 msgr2=0x7fa50c00b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.701 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa525b8a700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50c004e90 0x7fa50c00b770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa518002070 tx=0x7fa518007f30).stop 2020-11-20T11:50:48.701 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa525b8a700 1 -- 172.21.15.164:0/1470217739 shutdown_connections 2020-11-20T11:50:48.701 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa525b8a700 1 --2- 172.21.15.164:0/1470217739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa50c004e90 0x7fa50c00b770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.701 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa525b8a700 1 -- 172.21.15.164:0/1470217739 >> 172.21.15.164:0/1470217739 conn(0x7fa5200678e0 msgr2=0x7fa520067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:48.701 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa525b8a700 1 -- 172.21.15.164:0/1470217739 shutdown_connections 2020-11-20T11:50:48.702 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.688+0000 7fa525b8a700 1 -- 172.21.15.164:0/1470217739 wait complete. 2020-11-20T11:50:48.702 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa525b8a700 1 Processor -- start 2020-11-20T11:50:48.702 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa525b8a700 1 -- start start 2020-11-20T11:50:48.705 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa525b8a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004e90 0x7fa520112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.705 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa525b8a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa52014e070 0x7fa520163f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.705 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa525b8a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa52014c150 0x7fa520148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.705 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa525b8a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200c32b0 con 0x7fa50c004e90 2020-11-20T11:50:48.705 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa525b8a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa520164470 con 0x7fa52014e070 2020-11-20T11:50:48.706 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa525b8a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa520112d10 con 0x7fa52014c150 2020-11-20T11:50:48.706 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa51effd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa52014e070 0x7fa520163f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.706 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa51effd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa52014e070 0x7fa520163f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45812/0 (socket says 172.21.15.164:45812) 2020-11-20T11:50:48.706 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.690+0000 7fa51effd700 1 -- 172.21.15.164:0/1756416244 learned_addr learned my addr 172.21.15.164:0/1756416244 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:48.707 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa51ffff700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa52014c150 0x7fa520148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.707 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa51f7fe700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004e90 0x7fa520112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.707 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa51effd700 1 -- 172.21.15.164:0/1756416244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa52014c150 msgr2=0x7fa520148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.707 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa51effd700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa52014c150 0x7fa520148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.707 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa51effd700 1 -- 172.21.15.164:0/1756416244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004e90 msgr2=0x7fa520112760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.708 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa51effd700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004e90 0x7fa520112760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.708 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa51effd700 1 -- 172.21.15.164:0/1756416244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520112fb0 con 0x7fa52014e070 2020-11-20T11:50:48.708 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa51f7fe700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004e90 0x7fa520112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:48.708 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa51effd700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa52014e070 0x7fa520163f80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa5140014b0 tx=0x7fa520151910).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.708 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa4ff7fe700 1 -- 172.21.15.164:0/1756416244 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51400a830 con 0x7fa52014e070 2020-11-20T11:50:48.709 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa4ff7fe700 1 -- 172.21.15.164:0/1756416244 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa514010040 con 0x7fa52014e070 2020-11-20T11:50:48.709 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa525b8a700 1 -- 172.21.15.164:0/1756416244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5201600f0 con 0x7fa52014e070 2020-11-20T11:50:48.709 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa4ff7fe700 1 -- 172.21.15.164:0/1756416244 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51400abc0 con 0x7fa52014e070 2020-11-20T11:50:48.709 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.691+0000 7fa525b8a700 1 -- 172.21.15.164:0/1756416244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa520160630 con 0x7fa52014e070 2020-11-20T11:50:48.709 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.692+0000 7fa525b8a700 1 -- 172.21.15.164:0/1756416244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5200c3760 con 0x7fa52014e070 2020-11-20T11:50:48.710 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.692+0000 7fa4ff7fe700 1 -- 172.21.15.164:0/1756416244 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa51401b020 con 0x7fa52014e070 2020-11-20T11:50:48.710 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.693+0000 7fa4ff7fe700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa4f80806a0 0x7fa4f8082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.710 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.693+0000 7fa4ff7fe700 1 -- 172.21.15.164:0/1756416244 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa5140a21e0 con 0x7fa52014e070 2020-11-20T11:50:48.710 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.693+0000 7fa51f7fe700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa4f80806a0 0x7fa4f8082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.710 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.693+0000 7fa51f7fe700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa4f80806a0 0x7fa4f8082b60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa510007fd0 tx=0x7fa510009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.711 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.696+0000 7fa4ff7fe700 1 -- 172.21.15.164:0/1756416244 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa514076bf0 con 0x7fa52014e070 2020-11-20T11:50:48.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.837+0000 7fa525b8a700 1 -- 172.21.15.164:0/1756416244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa520069b70 con 0x7fa52014e070 2020-11-20T11:50:48.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.837+0000 7fa4ff7fe700 1 -- 172.21.15.164:0/1756416244 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa51407a210 con 0x7fa52014e070 2020-11-20T11:50:48.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 -- 172.21.15.164:0/1756416244 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa4f80806a0 msgr2=0x7fa4f8082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa4f80806a0 0x7fa4f8082b60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa510007fd0 tx=0x7fa510009040).stop 2020-11-20T11:50:48.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 -- 172.21.15.164:0/1756416244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa52014e070 msgr2=0x7fa520163f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa52014e070 0x7fa520163f80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa5140014b0 tx=0x7fa520151910).stop 2020-11-20T11:50:48.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 -- 172.21.15.164:0/1756416244 shutdown_connections 2020-11-20T11:50:48.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa4f80806a0 0x7fa4f8082b60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa52014c150 0x7fa520148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa50c004e90 0x7fa520112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 --2- 172.21.15.164:0/1756416244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa52014e070 0x7fa520163f80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 -- 172.21.15.164:0/1756416244 >> 172.21.15.164:0/1756416244 conn(0x7fa5200678e0 msgr2=0x7fa5200bdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:48.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 -- 172.21.15.164:0/1756416244 shutdown_connections 2020-11-20T11:50:48.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.838+0000 7fa525b8a700 1 -- 172.21.15.164:0/1756416244 wait complete. 2020-11-20T11:50:48.846 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:48.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.7 2020-11-20T11:50:48.854 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2020-11-20T11:50:48.966 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.963+0000 7f47f4521700 1 Processor -- start 2020-11-20T11:50:48.967 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.963+0000 7f47f4521700 1 -- start start 2020-11-20T11:50:48.969 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f4521700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f47ec0650f0 0x7f47ec062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.969 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f4521700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f47ec151c40 0x7f47ec067030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.969 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f4521700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec062a60 con 0x7f47ec064d10 2020-11-20T11:50:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f4521700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec067520 con 0x7f47ec151c40 2020-11-20T11:50:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f4521700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec062520 con 0x7f47ec0650f0 2020-11-20T11:50:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f1abc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f47ec0650f0 0x7f47ec062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f1abc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f47ec0650f0 0x7f47ec062ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45822/0 (socket says 172.21.15.164:45822) 2020-11-20T11:50:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f1abc700 1 -- 172.21.15.164:0/1174452724 learned_addr learned my addr 172.21.15.164:0/1174452724 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:48.971 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f2abe700 1 --2- 172.21.15.164:0/1174452724 >> v2:172.21.15.36:3300/0 conn(0x7f47ec151c40 0x7f47ec067030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.971 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f1abc700 1 -- 172.21.15.164:0/1174452724 >> v2:172.21.15.36:3300/0 conn(0x7f47ec151c40 msgr2=0x7f47ec067030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:48.971 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f1abc700 1 --2- 172.21.15.164:0/1174452724 >> v2:172.21.15.36:3300/0 conn(0x7f47ec151c40 0x7f47ec067030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.971 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f1abc700 1 -- 172.21.15.164:0/1174452724 >> v1:172.21.15.188:6789/0 conn(0x7f47ec064d10 legacy=0x7f47ec0baf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.971 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f1abc700 1 -- 172.21.15.164:0/1174452724 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec1520d0 con 0x7f47ec0650f0 2020-11-20T11:50:48.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f1abc700 1 --2- 172.21.15.164:0/1174452724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 0x7f47ec062ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f47ec0c2030 tx=0x7f47dc006ef0).ready entity=mon.1 client_cookie=22b28ae3e4af3726 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f12bb700 1 -- 172.21.15.164:0/1174452724 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00b8f0 con 0x7f47ec0650f0 2020-11-20T11:50:48.972 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f12bb700 1 -- 172.21.15.164:0/1174452724 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc000e90 con 0x7f47ec0650f0 2020-11-20T11:50:48.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.964+0000 7f47f12bb700 1 -- 172.21.15.164:0/1174452724 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00bc60 con 0x7f47ec0650f0 2020-11-20T11:50:48.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.965+0000 7f47f4521700 1 -- 172.21.15.164:0/1174452724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 msgr2=0x7f47ec062ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.973 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.965+0000 7f47f4521700 1 --2- 172.21.15.164:0/1174452724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 0x7f47ec062ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f47ec0c2030 tx=0x7f47dc006ef0).stop 2020-11-20T11:50:48.974 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.965+0000 7f47f4521700 1 -- 172.21.15.164:0/1174452724 shutdown_connections 2020-11-20T11:50:48.974 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.965+0000 7f47f4521700 1 --2- 172.21.15.164:0/1174452724 >> v2:172.21.15.36:3300/0 conn(0x7f47ec151c40 0x7f47ec067030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.974 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.965+0000 7f47f4521700 1 --2- 172.21.15.164:0/1174452724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 0x7f47ec062ef0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.975 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.965+0000 7f47f4521700 1 -- 172.21.15.164:0/1174452724 >> 172.21.15.164:0/1174452724 conn(0x7f47ec0c55c0 msgr2=0x7f47ec0c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:48.975 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.965+0000 7f47f4521700 1 -- 172.21.15.164:0/1174452724 shutdown_connections 2020-11-20T11:50:48.975 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.965+0000 7f47f4521700 1 -- 172.21.15.164:0/1174452724 wait complete. 2020-11-20T11:50:48.979 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.966+0000 7f47f4521700 1 Processor -- start 2020-11-20T11:50:48.979 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.966+0000 7f47f4521700 1 -- start start 2020-11-20T11:50:48.979 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f4521700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47ec064d10 0x7f47ec1606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.979 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f4521700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 0x7f47ec0c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.980 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f4521700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47ec151c40 0x7f47ec1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.980 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f4521700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec161b40 con 0x7f47ec151c40 2020-11-20T11:50:48.980 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f4521700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec160f30 con 0x7f47ec0650f0 2020-11-20T11:50:48.980 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f4521700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec1611d0 con 0x7f47ec064d10 2020-11-20T11:50:48.981 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f1abc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 0x7f47ec0c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.981 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f1abc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 0x7f47ec0c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45826/0 (socket says 172.21.15.164:45826) 2020-11-20T11:50:48.981 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f1abc700 1 -- 172.21.15.164:0/2357905368 learned_addr learned my addr 172.21.15.164:0/2357905368 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:48.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f2abe700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47ec151c40 0x7f47ec1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f22bd700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47ec064d10 0x7f47ec1606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f1abc700 1 -- 172.21.15.164:0/2357905368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47ec064d10 msgr2=0x7f47ec1606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f1abc700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47ec064d10 0x7f47ec1606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f1abc700 1 -- 172.21.15.164:0/2357905368 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47ec151c40 msgr2=0x7f47ec1525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:48.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f1abc700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47ec151c40 0x7f47ec1525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:48.984 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f1abc700 1 -- 172.21.15.164:0/2357905368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec161470 con 0x7f47ec0650f0 2020-11-20T11:50:48.984 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f1abc700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 0x7f47ec0c4800 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f47dc009fd0 tx=0x7f47dc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.985 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47da7fc700 1 -- 172.21.15.164:0/2357905368 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc01d480 con 0x7f47ec0650f0 2020-11-20T11:50:48.985 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47da7fc700 1 -- 172.21.15.164:0/2357905368 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc01d5e0 con 0x7f47ec0650f0 2020-11-20T11:50:48.985 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f4521700 1 -- 172.21.15.164:0/2357905368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec161d70 con 0x7f47ec0650f0 2020-11-20T11:50:48.985 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47da7fc700 1 -- 172.21.15.164:0/2357905368 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc01d980 con 0x7f47ec0650f0 2020-11-20T11:50:48.986 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.967+0000 7f47f4521700 1 -- 172.21.15.164:0/2357905368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec160ba0 con 0x7f47ec0650f0 2020-11-20T11:50:48.986 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.968+0000 7f47f4521700 1 -- 172.21.15.164:0/2357905368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec1621d0 con 0x7f47ec0650f0 2020-11-20T11:50:48.986 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.969+0000 7f47da7fc700 1 -- 172.21.15.164:0/2357905368 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f47dc017070 con 0x7f47ec0650f0 2020-11-20T11:50:48.986 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.969+0000 7f47da7fc700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f47c4080670 0x7f47c4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:48.987 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.969+0000 7f47da7fc700 1 -- 172.21.15.164:0/2357905368 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f47dc0a4a50 con 0x7f47ec0650f0 2020-11-20T11:50:48.987 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.970+0000 7f47f22bd700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f47c4080670 0x7f47c4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:48.987 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.970+0000 7f47f22bd700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f47c4080670 0x7f47c4082b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f47e8003590 tx=0x7f47e8009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:48.987 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:48.973+0000 7f47da7fc700 1 -- 172.21.15.164:0/2357905368 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f47dc079460 con 0x7f47ec0650f0 2020-11-20T11:50:49.115 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.112+0000 7f47f4521700 1 -- 172.21.15.164:0/2357905368 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f47ec069b70 con 0x7f47ec0650f0 2020-11-20T11:50:49.116 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.112+0000 7f47da7fc700 1 -- 172.21.15.164:0/2357905368 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47dc015030 con 0x7f47ec0650f0 2020-11-20T11:50:49.116 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:49.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 -- 172.21.15.164:0/2357905368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f47c4080670 msgr2=0x7f47c4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f47c4080670 0x7f47c4082b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f47e8003590 tx=0x7f47e8009040).stop 2020-11-20T11:50:49.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 -- 172.21.15.164:0/2357905368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 msgr2=0x7f47ec0c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 0x7f47ec0c4800 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f47dc009fd0 tx=0x7f47dc016000).stop 2020-11-20T11:50:49.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 -- 172.21.15.164:0/2357905368 shutdown_connections 2020-11-20T11:50:49.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f47c4080670 0x7f47c4082b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47ec151c40 0x7f47ec1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47ec064d10 0x7f47ec1606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 --2- 172.21.15.164:0/2357905368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47ec0650f0 0x7f47ec0c4800 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 -- 172.21.15.164:0/2357905368 >> 172.21.15.164:0/2357905368 conn(0x7f47ec0c55c0 msgr2=0x7f47ec14df90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:49.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 -- 172.21.15.164:0/2357905368 shutdown_connections 2020-11-20T11:50:49.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.113+0000 7f47f4521700 1 -- 172.21.15.164:0/2357905368 wait complete. 2020-11-20T11:50:49.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444038 for osd.8 2020-11-20T11:50:49.130 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2020-11-20T11:50:49.245 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.242+0000 7fbe92d36700 1 Processor -- start 2020-11-20T11:50:49.246 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.242+0000 7fbe92d36700 1 -- start start 2020-11-20T11:50:49.248 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.242+0000 7fbe92d36700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbe8c09a930 0x7fbe8c066c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.248 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.242+0000 7fbe92d36700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8c09b7c0 con 0x7fbe8c066850 2020-11-20T11:50:49.248 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.242+0000 7fbe92d36700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8c09ba20 con 0x7fbe8c063da0 2020-11-20T11:50:49.249 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.242+0000 7fbe92d36700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c14f2a0 con 0x7fbe8c09a930 2020-11-20T11:50:49.249 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe912d3700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fbe8c063da0 0x7fbe8c064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55574/0 (socket says 172.21.15.164:55574) 2020-11-20T11:50:49.249 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe912d3700 1 -- 172.21.15.164:0/1677185117 learned_addr learned my addr 172.21.15.164:0/1677185117 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:49.249 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8bfff700 1 --2- 172.21.15.164:0/1677185117 >> v2:172.21.15.36:3300/0 conn(0x7fbe8c09a930 0x7fbe8c066c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.249 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8b7fe700 1 -- 172.21.15.164:0/1677185117 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138347313 0 0) 0x7fbe8c09ba20 con 0x7fbe8c063da0 2020-11-20T11:50:49.250 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8b7fe700 1 -- 172.21.15.164:0/1677185117 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe70003280 con 0x7fbe8c063da0 2020-11-20T11:50:49.250 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8b7fe700 1 -- 172.21.15.164:0/1677185117 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1952103414 0 0) 0x7fbe70003280 con 0x7fbe8c063da0 2020-11-20T11:50:49.250 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8bfff700 1 -- 172.21.15.164:0/1677185117 >> v1:172.21.15.164:6789/0 conn(0x7fbe8c063da0 legacy=0x7fbe8c064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.250 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8bfff700 1 -- 172.21.15.164:0/1677185117 >> v1:172.21.15.36:6789/0 conn(0x7fbe8c066850 legacy=0x7fbe8c09b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.250 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8bfff700 1 -- 172.21.15.164:0/1677185117 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c14f540 con 0x7fbe8c09a930 2020-11-20T11:50:49.251 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8bfff700 1 --2- 172.21.15.164:0/1677185117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe8c09a930 0x7fbe8c066c30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fbe78006fd0 tx=0x7fbe78006e30).ready entity=mon.0 client_cookie=d4713310d5dde051 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:49.251 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8b7fe700 1 -- 172.21.15.164:0/1677185117 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe840018a0 con 0x7fbe8c09a930 2020-11-20T11:50:49.251 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8b7fe700 1 -- 172.21.15.164:0/1677185117 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe78000e90 con 0x7fbe8c09a930 2020-11-20T11:50:49.251 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.243+0000 7fbe8b7fe700 1 -- 172.21.15.164:0/1677185117 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78011610 con 0x7fbe8c09a930 2020-11-20T11:50:49.251 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.244+0000 7fbe92d36700 1 -- 172.21.15.164:0/1677185117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe8c09a930 msgr2=0x7fbe8c066c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.252 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.244+0000 7fbe92d36700 1 --2- 172.21.15.164:0/1677185117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe8c09a930 0x7fbe8c066c30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fbe78006fd0 tx=0x7fbe78006e30).stop 2020-11-20T11:50:49.252 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.244+0000 7fbe92d36700 1 -- 172.21.15.164:0/1677185117 shutdown_connections 2020-11-20T11:50:49.252 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.244+0000 7fbe92d36700 1 --2- 172.21.15.164:0/1677185117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe8c09a930 0x7fbe8c066c30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.252 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.244+0000 7fbe92d36700 1 -- 172.21.15.164:0/1677185117 >> 172.21.15.164:0/1677185117 conn(0x7fbe8c060c80 msgr2=0x7fbe8c0c5660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:49.252 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.244+0000 7fbe92d36700 1 -- 172.21.15.164:0/1677185117 shutdown_connections 2020-11-20T11:50:49.253 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.244+0000 7fbe92d36700 1 -- 172.21.15.164:0/1677185117 wait complete. 2020-11-20T11:50:49.260 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.245+0000 7fbe92d36700 1 Processor -- start 2020-11-20T11:50:49.262 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.245+0000 7fbe92d36700 1 -- start start 2020-11-20T11:50:49.262 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe92d36700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe8c063da0 0x7fbe8c162570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.262 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe92d36700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe8c066850 0x7fbe8c0bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.262 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe92d36700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe8c09a930 0x7fbe8c0c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.263 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe92d36700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c15e600 con 0x7fbe8c063da0 2020-11-20T11:50:49.263 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe92d36700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c162a60 con 0x7fbe8c09a930 2020-11-20T11:50:49.263 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe92d36700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0bd660 con 0x7fbe8c066850 2020-11-20T11:50:49.263 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe912d3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe8c09a930 0x7fbe8c0c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe912d3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe8c09a930 0x7fbe8c0c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45840/0 (socket says 172.21.15.164:45840) 2020-11-20T11:50:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe912d3700 1 -- 172.21.15.164:0/2433152642 learned_addr learned my addr 172.21.15.164:0/2433152642 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe8bfff700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe8c066850 0x7fbe8c0bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe90ad2700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe8c063da0 0x7fbe8c162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.264 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe912d3700 1 -- 172.21.15.164:0/2433152642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe8c066850 msgr2=0x7fbe8c0bcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.265 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe912d3700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe8c066850 0x7fbe8c0bcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.265 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe912d3700 1 -- 172.21.15.164:0/2433152642 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe8c063da0 msgr2=0x7fbe8c162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.265 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe912d3700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe8c063da0 0x7fbe8c162570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.265 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe912d3700 1 -- 172.21.15.164:0/2433152642 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c15e830 con 0x7fbe8c09a930 2020-11-20T11:50:49.265 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe912d3700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe8c09a930 0x7fbe8c0c4e40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fbe8400ce60 tx=0x7fbe840015b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.246+0000 7fbe88ff9700 1 -- 172.21.15.164:0/2433152642 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400aaf0 con 0x7fbe8c09a930 2020-11-20T11:50:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.247+0000 7fbe88ff9700 1 -- 172.21.15.164:0/2433152642 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8400ac50 con 0x7fbe8c09a930 2020-11-20T11:50:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.247+0000 7fbe92d36700 1 -- 172.21.15.164:0/2433152642 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8c15ead0 con 0x7fbe8c09a930 2020-11-20T11:50:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.247+0000 7fbe88ff9700 1 -- 172.21.15.164:0/2433152642 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe840048c0 con 0x7fbe8c09a930 2020-11-20T11:50:49.266 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.247+0000 7fbe92d36700 1 -- 172.21.15.164:0/2433152642 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8c15f010 con 0x7fbe8c09a930 2020-11-20T11:50:49.267 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.248+0000 7fbe92d36700 1 -- 172.21.15.164:0/2433152642 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8c0bd410 con 0x7fbe8c09a930 2020-11-20T11:50:49.267 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.248+0000 7fbe88ff9700 1 -- 172.21.15.164:0/2433152642 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fbe84010070 con 0x7fbe8c09a930 2020-11-20T11:50:49.267 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.248+0000 7fbe88ff9700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbe64080670 0x7fbe64082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.267 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.249+0000 7fbe88ff9700 1 -- 172.21.15.164:0/2433152642 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fbe840a2800 con 0x7fbe8c09a930 2020-11-20T11:50:49.267 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.249+0000 7fbe90ad2700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbe64080670 0x7fbe64082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.268 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.249+0000 7fbe90ad2700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbe64080670 0x7fbe64082b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbe80003590 tx=0x7fbe80009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:49.268 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.252+0000 7fbe88ff9700 1 -- 172.21.15.164:0/2433152642 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fbe84077210 con 0x7fbe8c09a930 2020-11-20T11:50:49.395 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.391+0000 7fbe92d36700 1 -- 172.21.15.164:0/2433152642 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fbe8c080ba0 con 0x7fbe8c09a930 2020-11-20T11:50:49.396 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.392+0000 7fbe88ff9700 1 -- 172.21.15.164:0/2433152642 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe8407a830 con 0x7fbe8c09a930 2020-11-20T11:50:49.396 INFO:teuthology.orchestra.run.smithi164.stdout:73014444037 2020-11-20T11:50:49.397 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 -- 172.21.15.164:0/2433152642 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbe64080670 msgr2=0x7fbe64082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.397 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbe64080670 0x7fbe64082b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbe80003590 tx=0x7fbe80009040).stop 2020-11-20T11:50:49.398 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 -- 172.21.15.164:0/2433152642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe8c09a930 msgr2=0x7fbe8c0c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.398 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe8c09a930 0x7fbe8c0c4e40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fbe8400ce60 tx=0x7fbe840015b0).stop 2020-11-20T11:50:49.398 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 -- 172.21.15.164:0/2433152642 shutdown_connections 2020-11-20T11:50:49.398 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fbe64080670 0x7fbe64082b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.399 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe8c09a930 0x7fbe8c0c4e40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.399 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe8c063da0 0x7fbe8c162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.399 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 --2- 172.21.15.164:0/2433152642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe8c066850 0x7fbe8c0bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.399 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 -- 172.21.15.164:0/2433152642 >> 172.21.15.164:0/2433152642 conn(0x7fbe8c060c80 msgr2=0x7fbe8c0c3760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:49.399 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 -- 172.21.15.164:0/2433152642 shutdown_connections 2020-11-20T11:50:49.400 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.393+0000 7fbe92d36700 1 -- 172.21.15.164:0/2433152642 wait complete. 2020-11-20T11:50:49.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444037 for osd.9 2020-11-20T11:50:49.409 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2020-11-20T11:50:49.519 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.515+0000 7fb12e846700 1 Processor -- start 2020-11-20T11:50:49.519 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.515+0000 7fb12e846700 1 -- start start 2020-11-20T11:50:49.521 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb12e846700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb1280bccf0 0x7fb1280c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.521 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb12e846700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb1280bf680 0x7fb1280bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.522 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb12e846700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1281555a0 con 0x7fb1280c4470 2020-11-20T11:50:49.522 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb12e846700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1280c0020 con 0x7fb1280bccf0 2020-11-20T11:50:49.522 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb12e846700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1281517d0 con 0x7fb1280bf680 2020-11-20T11:50:49.522 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb12cde3700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb1280bf680 0x7fb1280bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb127fff700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fb1280c4470 0x7fb1280c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.164:40902/0 (socket says 172.21.15.164:40902) 2020-11-20T11:50:49.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb127fff700 1 -- 172.21.15.164:0/4021458911 learned_addr learned my addr 172.21.15.164:0/4021458911 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:49.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb1277fe700 1 --2- 172.21.15.164:0/4021458911 >> v2:172.21.15.36:3300/0 conn(0x7fb1280bccf0 0x7fb1280c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb12cde3700 1 -- 172.21.15.164:0/4021458911 >> v2:172.21.15.36:3300/0 conn(0x7fb1280bccf0 msgr2=0x7fb1280c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:49.523 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb12cde3700 1 --2- 172.21.15.164:0/4021458911 >> v2:172.21.15.36:3300/0 conn(0x7fb1280bccf0 0x7fb1280c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb12cde3700 1 -- 172.21.15.164:0/4021458911 >> v1:172.21.15.188:6789/0 conn(0x7fb1280c4470 legacy=0x7fb1280c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb126ffd700 1 -- 172.21.15.164:0/4021458911 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486118018 0 0) 0x7fb1281555a0 con 0x7fb1280c4470 2020-11-20T11:50:49.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.516+0000 7fb12cde3700 1 -- 172.21.15.164:0/4021458911 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb128151a70 con 0x7fb1280bf680 2020-11-20T11:50:49.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb12cde3700 1 --2- 172.21.15.164:0/4021458911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1280bf680 0x7fb1280bfb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb1280c51c0 tx=0x7fb120009220).ready entity=mon.2 client_cookie=b857c5c433958295 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:49.524 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb126ffd700 1 -- 172.21.15.164:0/4021458911 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000ba90 con 0x7fb1280bf680 2020-11-20T11:50:49.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb126ffd700 1 -- 172.21.15.164:0/4021458911 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12000bbf0 con 0x7fb1280bf680 2020-11-20T11:50:49.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb126ffd700 1 -- 172.21.15.164:0/4021458911 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120011400 con 0x7fb1280bf680 2020-11-20T11:50:49.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb12e846700 1 -- 172.21.15.164:0/4021458911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1280bf680 msgr2=0x7fb1280bfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb12e846700 1 --2- 172.21.15.164:0/4021458911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1280bf680 0x7fb1280bfb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb1280c51c0 tx=0x7fb120009220).stop 2020-11-20T11:50:49.525 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb12e846700 1 -- 172.21.15.164:0/4021458911 shutdown_connections 2020-11-20T11:50:49.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb12e846700 1 --2- 172.21.15.164:0/4021458911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1280bf680 0x7fb1280bfb30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb12e846700 1 --2- 172.21.15.164:0/4021458911 >> v2:172.21.15.36:3300/0 conn(0x7fb1280bccf0 0x7fb1280c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb12e846700 1 -- 172.21.15.164:0/4021458911 >> 172.21.15.164:0/4021458911 conn(0x7fb1280683b0 msgr2=0x7fb128061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:49.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb12e846700 1 -- 172.21.15.164:0/4021458911 shutdown_connections 2020-11-20T11:50:49.526 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.517+0000 7fb12e846700 1 -- 172.21.15.164:0/4021458911 wait complete. 2020-11-20T11:50:49.529 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.518+0000 7fb12e846700 1 Processor -- start 2020-11-20T11:50:49.529 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.519+0000 7fb12e846700 1 -- start start 2020-11-20T11:50:49.529 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.519+0000 7fb12e846700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1280bccf0 0x7fb128144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.530 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.519+0000 7fb12e846700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1280bf680 0x7fb1281640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.530 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.519+0000 7fb12e846700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1280c4470 0x7fb128143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.530 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.519+0000 7fb12e846700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb128144d30 con 0x7fb1280bccf0 2020-11-20T11:50:49.530 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.519+0000 7fb12e846700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1281645d0 con 0x7fb1280bf680 2020-11-20T11:50:49.530 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.519+0000 7fb12e846700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb128144f70 con 0x7fb1280c4470 2020-11-20T11:50:49.531 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb1277fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1280bf680 0x7fb1281640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.531 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb1277fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1280bf680 0x7fb1281640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45854/0 (socket says 172.21.15.164:45854) 2020-11-20T11:50:49.531 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb1277fe700 1 -- 172.21.15.164:0/3878704698 learned_addr learned my addr 172.21.15.164:0/3878704698 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:49.531 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb127fff700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1280bccf0 0x7fb128144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.531 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb12cde3700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1280c4470 0x7fb128143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.532 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb1277fe700 1 -- 172.21.15.164:0/3878704698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1280c4470 msgr2=0x7fb128143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.532 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb1277fe700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1280c4470 0x7fb128143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.532 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb1277fe700 1 -- 172.21.15.164:0/3878704698 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1280bccf0 msgr2=0x7fb128144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.532 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb1277fe700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1280bccf0 0x7fb128144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.533 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb1277fe700 1 -- 172.21.15.164:0/3878704698 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb128160330 con 0x7fb1280bf680 2020-11-20T11:50:49.533 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb1277fe700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1280bf680 0x7fb1281640e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fb11800ebd0 tx=0x7fb118006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:49.533 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb10ffff700 1 -- 172.21.15.164:0/3878704698 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800c8e0 con 0x7fb1280bf680 2020-11-20T11:50:49.533 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb10ffff700 1 -- 172.21.15.164:0/3878704698 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11800ca40 con 0x7fb1280bf680 2020-11-20T11:50:49.533 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb12e846700 1 -- 172.21.15.164:0/3878704698 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1281605d0 con 0x7fb1280bf680 2020-11-20T11:50:49.534 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb10ffff700 1 -- 172.21.15.164:0/3878704698 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800cdc0 con 0x7fb1280bf680 2020-11-20T11:50:49.534 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.520+0000 7fb12e846700 1 -- 172.21.15.164:0/3878704698 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb128160b10 con 0x7fb1280bf680 2020-11-20T11:50:49.535 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.521+0000 7fb12e846700 1 -- 172.21.15.164:0/3878704698 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb128069b70 con 0x7fb1280bf680 2020-11-20T11:50:49.535 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.522+0000 7fb10ffff700 1 -- 172.21.15.164:0/3878704698 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb118012600 con 0x7fb1280bf680 2020-11-20T11:50:49.535 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.522+0000 7fb10ffff700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb104080670 0x7fb104082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.535 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.522+0000 7fb10ffff700 1 -- 172.21.15.164:0/3878704698 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb1180a2e60 con 0x7fb1280bf680 2020-11-20T11:50:49.535 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.522+0000 7fb127fff700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb104080670 0x7fb104082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.536 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.522+0000 7fb127fff700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb104080670 0x7fb104082b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb11c0067c0 tx=0x7fb11c007c60).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:49.536 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.525+0000 7fb10ffff700 1 -- 172.21.15.164:0/3878704698 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb118077870 con 0x7fb1280bf680 2020-11-20T11:50:49.669 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.665+0000 7fb12e846700 1 -- 172.21.15.164:0/3878704698 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fb12805d590 con 0x7fb1280bf680 2020-11-20T11:50:49.670 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.666+0000 7fb10ffff700 1 -- 172.21.15.164:0/3878704698 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7fb11807ae90 con 0x7fb1280bf680 2020-11-20T11:50:49.670 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:49.671 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.667+0000 7fb12e846700 1 -- 172.21.15.164:0/3878704698 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb104080670 msgr2=0x7fb104082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.667+0000 7fb12e846700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb104080670 0x7fb104082b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb11c0067c0 tx=0x7fb11c007c60).stop 2020-11-20T11:50:49.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.667+0000 7fb12e846700 1 -- 172.21.15.164:0/3878704698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1280bf680 msgr2=0x7fb1281640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.667+0000 7fb12e846700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1280bf680 0x7fb1281640e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fb11800ebd0 tx=0x7fb118006e30).stop 2020-11-20T11:50:49.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.667+0000 7fb12e846700 1 -- 172.21.15.164:0/3878704698 shutdown_connections 2020-11-20T11:50:49.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.667+0000 7fb12e846700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb104080670 0x7fb104082b30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.673 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.667+0000 7fb12e846700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1280c4470 0x7fb128143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.673 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.667+0000 7fb12e846700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1280bccf0 0x7fb128144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.673 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.667+0000 7fb12e846700 1 --2- 172.21.15.164:0/3878704698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1280bf680 0x7fb1281640e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.673 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.667+0000 7fb12e846700 1 -- 172.21.15.164:0/3878704698 >> 172.21.15.164:0/3878704698 conn(0x7fb1280683b0 msgr2=0x7fb1280807d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:49.674 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.668+0000 7fb12e846700 1 -- 172.21.15.164:0/3878704698 shutdown_connections 2020-11-20T11:50:49.674 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.668+0000 7fb12e846700 1 -- 172.21.15.164:0/3878704698 wait complete. 2020-11-20T11:50:49.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.10 2020-11-20T11:50:49.683 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2020-11-20T11:50:49.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.789+0000 7f3a7da20700 1 Processor -- start 2020-11-20T11:50:49.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.789+0000 7f3a7da20700 1 -- start start 2020-11-20T11:50:49.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.790+0000 7f3a7da20700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3a780c4470 0x7f3a780c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.790+0000 7f3a7da20700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3a780bccf0 0x7f3a780c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.790+0000 7f3a7da20700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a781555a0 con 0x7f3a780c10e0 2020-11-20T11:50:49.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.790+0000 7f3a7da20700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a781517d0 con 0x7f3a780bccf0 2020-11-20T11:50:49.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.790+0000 7f3a7da20700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a78151a70 con 0x7f3a780c4470 2020-11-20T11:50:49.798 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.790+0000 7f3a76ffd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3a780c4470 0x7f3a780c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.790+0000 7f3a777fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f3a780c10e0 0x7f3a780bf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55602/0 (socket says 172.21.15.164:55602) 2020-11-20T11:50:49.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.790+0000 7f3a777fe700 1 -- 172.21.15.164:0/2869339356 learned_addr learned my addr 172.21.15.164:0/2869339356 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:49.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a6ffff700 1 --2- 172.21.15.164:0/2869339356 >> v2:172.21.15.36:3300/0 conn(0x7f3a780bccf0 0x7f3a780c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a76ffd700 1 -- 172.21.15.164:0/2869339356 >> v2:172.21.15.36:3300/0 conn(0x7f3a780bccf0 msgr2=0x7f3a780c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:49.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a76ffd700 1 --2- 172.21.15.164:0/2869339356 >> v2:172.21.15.36:3300/0 conn(0x7f3a780bccf0 0x7f3a780c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a76ffd700 1 -- 172.21.15.164:0/2869339356 >> v1:172.21.15.164:6789/0 conn(0x7f3a780c10e0 legacy=0x7f3a780bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a76ffd700 1 -- 172.21.15.164:0/2869339356 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78151d10 con 0x7f3a780c4470 2020-11-20T11:50:49.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a6ffff700 1 --2- 172.21.15.164:0/2869339356 >> v2:172.21.15.36:3300/0 conn(0x7f3a780bccf0 0x7f3a780c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:49.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a76ffd700 1 --2- 172.21.15.164:0/2869339356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 0x7f3a780c4850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3a78081020 tx=0x7f3a68006e30).ready entity=mon.1 client_cookie=d9f0c59cb4bbe66d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:49.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a767fc700 1 -- 172.21.15.164:0/2869339356 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68009840 con 0x7f3a780c4470 2020-11-20T11:50:49.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a767fc700 1 -- 172.21.15.164:0/2869339356 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68000e90 con 0x7f3a780c4470 2020-11-20T11:50:49.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a767fc700 1 -- 172.21.15.164:0/2869339356 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68009bb0 con 0x7f3a780c4470 2020-11-20T11:50:49.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a7da20700 1 -- 172.21.15.164:0/2869339356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 msgr2=0x7f3a780c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a7da20700 1 --2- 172.21.15.164:0/2869339356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 0x7f3a780c4850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3a78081020 tx=0x7f3a68006e30).stop 2020-11-20T11:50:49.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.791+0000 7f3a7da20700 1 -- 172.21.15.164:0/2869339356 shutdown_connections 2020-11-20T11:50:49.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.792+0000 7f3a7da20700 1 --2- 172.21.15.164:0/2869339356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 0x7f3a780c4850 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.792+0000 7f3a7da20700 1 --2- 172.21.15.164:0/2869339356 >> v2:172.21.15.36:3300/0 conn(0x7f3a780bccf0 0x7f3a780c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.792+0000 7f3a7da20700 1 -- 172.21.15.164:0/2869339356 >> 172.21.15.164:0/2869339356 conn(0x7f3a780683b0 msgr2=0x7f3a78061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:49.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.792+0000 7f3a7da20700 1 -- 172.21.15.164:0/2869339356 shutdown_connections 2020-11-20T11:50:49.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.792+0000 7f3a7da20700 1 -- 172.21.15.164:0/2869339356 wait complete. 2020-11-20T11:50:49.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.793+0000 7f3a7da20700 1 Processor -- start 2020-11-20T11:50:49.804 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.793+0000 7f3a7da20700 1 -- start start 2020-11-20T11:50:49.807 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.793+0000 7f3a7da20700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a780bccf0 0x7f3a78158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.807 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.793+0000 7f3a7da20700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a780c10e0 0x7f3a781563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.808 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.793+0000 7f3a7da20700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 0x7f3a7814c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.808 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.793+0000 7f3a7da20700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78112700 con 0x7f3a780c10e0 2020-11-20T11:50:49.808 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.793+0000 7f3a7da20700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78156890 con 0x7f3a780c4470 2020-11-20T11:50:49.808 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.793+0000 7f3a7da20700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78156a90 con 0x7f3a780bccf0 2020-11-20T11:50:49.809 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.793+0000 7f3a777fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 0x7f3a7814c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.809 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.793+0000 7f3a777fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 0x7f3a7814c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45870/0 (socket says 172.21.15.164:45870) 2020-11-20T11:50:49.809 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a777fe700 1 -- 172.21.15.164:0/666693141 learned_addr learned my addr 172.21.15.164:0/666693141 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:49.809 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a6ffff700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a780c10e0 0x7f3a781563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a76ffd700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a780bccf0 0x7f3a78158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a777fe700 1 -- 172.21.15.164:0/666693141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a780bccf0 msgr2=0x7f3a78158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a777fe700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a780bccf0 0x7f3a78158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a777fe700 1 -- 172.21.15.164:0/666693141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a780c10e0 msgr2=0x7f3a781563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.810 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a777fe700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a780c10e0 0x7f3a781563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.811 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a777fe700 1 -- 172.21.15.164:0/666693141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a781128f0 con 0x7f3a780c4470 2020-11-20T11:50:49.811 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a76ffd700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a780bccf0 0x7f3a78158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:49.811 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a777fe700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 0x7f3a7814c130 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f3a7000cac0 tx=0x7f3a7000cdd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:49.811 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a6effd700 1 -- 172.21.15.164:0/666693141 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70005bc0 con 0x7f3a780c4470 2020-11-20T11:50:49.812 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a6effd700 1 -- 172.21.15.164:0/666693141 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a70005d20 con 0x7f3a780c4470 2020-11-20T11:50:49.812 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a7da20700 1 -- 172.21.15.164:0/666693141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a78112b90 con 0x7f3a780c4470 2020-11-20T11:50:49.812 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a6effd700 1 -- 172.21.15.164:0/666693141 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70007320 con 0x7f3a780c4470 2020-11-20T11:50:49.812 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.794+0000 7f3a7da20700 1 -- 172.21.15.164:0/666693141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a781619c0 con 0x7f3a780c4470 2020-11-20T11:50:49.813 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.795+0000 7f3a7da20700 1 -- 172.21.15.164:0/666693141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a78069b70 con 0x7f3a780c4470 2020-11-20T11:50:49.813 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.796+0000 7f3a6effd700 1 -- 172.21.15.164:0/666693141 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3a70010030 con 0x7f3a780c4470 2020-11-20T11:50:49.813 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.796+0000 7f3a6effd700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a54080670 0x7f3a54082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:49.813 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.796+0000 7f3a6effd700 1 -- 172.21.15.164:0/666693141 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3a700a2a70 con 0x7f3a780c4470 2020-11-20T11:50:49.813 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.796+0000 7f3a76ffd700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a54080670 0x7f3a54082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:49.814 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.796+0000 7f3a76ffd700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a54080670 0x7f3a54082b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3a68009fd0 tx=0x7f3a68015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:49.814 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.799+0000 7f3a6effd700 1 -- 172.21.15.164:0/666693141 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3a70077480 con 0x7f3a780c4470 2020-11-20T11:50:49.947 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.939+0000 7f3a7da20700 1 -- 172.21.15.164:0/666693141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f3a7805d590 con 0x7f3a780c4470 2020-11-20T11:50:49.948 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.939+0000 7f3a6effd700 1 -- 172.21.15.164:0/666693141 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f3a7007aaa0 con 0x7f3a780c4470 2020-11-20T11:50:49.948 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 -- 172.21.15.164:0/666693141 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a54080670 msgr2=0x7f3a54082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.948 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a54080670 0x7f3a54082b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3a68009fd0 tx=0x7f3a68015000).stop 2020-11-20T11:50:49.948 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 -- 172.21.15.164:0/666693141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 msgr2=0x7f3a7814c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:49.948 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 0x7f3a7814c130 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f3a7000cac0 tx=0x7f3a7000cdd0).stop 2020-11-20T11:50:49.949 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 -- 172.21.15.164:0/666693141 shutdown_connections 2020-11-20T11:50:49.949 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3a54080670 0x7f3a54082b30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.949 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a780c4470 0x7f3a7814c130 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.949 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a780bccf0 0x7f3a78158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.949 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 --2- 172.21.15.164:0/666693141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a780c10e0 0x7f3a781563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:49.950 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 -- 172.21.15.164:0/666693141 >> 172.21.15.164:0/666693141 conn(0x7f3a780683b0 msgr2=0x7f3a7814dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:49.950 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 -- 172.21.15.164:0/666693141 shutdown_connections 2020-11-20T11:50:49.950 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:49.941+0000 7f3a7da20700 1 -- 172.21.15.164:0/666693141 wait complete. 2020-11-20T11:50:49.950 INFO:teuthology.orchestra.run.smithi164.stdout:73014444038 2020-11-20T11:50:49.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444038 for osd.11 2020-11-20T11:50:49.956 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-20T11:50:49.957 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:50:50.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.063+0000 7f0f18e19700 1 Processor -- start 2020-11-20T11:50:50.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.064+0000 7f0f18e19700 1 -- start start 2020-11-20T11:50:50.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.064+0000 7f0f18e19700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0f140bf9a0 0x7f0f140bfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:50.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.064+0000 7f0f18e19700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f141516d0 con 0x7f0f140c49b0 2020-11-20T11:50:50.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.064+0000 7f0f18e19700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f14151970 con 0x7f0f140c0bb0 2020-11-20T11:50:50.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.064+0000 7f0f18e19700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f14151c10 con 0x7f0f140bf9a0 2020-11-20T11:50:50.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.064+0000 7f0f1259c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0f140bf9a0 0x7f0f140bfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:50.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.065+0000 7f0f0bfff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0f140c0bb0 0x7f0f140c42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55616/0 (socket says 172.21.15.164:55616) 2020-11-20T11:50:50.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.065+0000 7f0f0bfff700 1 -- 172.21.15.164:0/344457074 learned_addr learned my addr 172.21.15.164:0/344457074 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:50.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.065+0000 7f0f1259c700 1 -- 172.21.15.164:0/344457074 >> v1:172.21.15.164:6789/0 conn(0x7f0f140c0bb0 legacy=0x7f0f140c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.065+0000 7f0f1259c700 1 -- 172.21.15.164:0/344457074 >> v1:172.21.15.36:6789/0 conn(0x7f0f140c49b0 legacy=0x7f0f14150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.065+0000 7f0f11d9b700 1 -- 172.21.15.164:0/344457074 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017716762 0 0) 0x7f0f14151970 con 0x7f0f140c0bb0 2020-11-20T11:50:50.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.065+0000 7f0f1259c700 1 -- 172.21.15.164:0/344457074 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14151eb0 con 0x7f0f140bf9a0 2020-11-20T11:50:50.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.065+0000 7f0f1259c700 1 --2- 172.21.15.164:0/344457074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140bf9a0 0x7f0f140bfd80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0f04006fd0 tx=0x7f0f04006e30).ready entity=mon.1 client_cookie=f31afe69160110da server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:50.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.065+0000 7f0f11d9b700 1 -- 172.21.15.164:0/344457074 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f040097e0 con 0x7f0f140bf9a0 2020-11-20T11:50:50.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.065+0000 7f0f11d9b700 1 -- 172.21.15.164:0/344457074 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f04000e90 con 0x7f0f140bf9a0 2020-11-20T11:50:50.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.065+0000 7f0f11d9b700 1 -- 172.21.15.164:0/344457074 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04009b50 con 0x7f0f140bf9a0 2020-11-20T11:50:50.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.066+0000 7f0f18e19700 1 -- 172.21.15.164:0/344457074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140bf9a0 msgr2=0x7f0f140bfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.066+0000 7f0f18e19700 1 --2- 172.21.15.164:0/344457074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140bf9a0 0x7f0f140bfd80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0f04006fd0 tx=0x7f0f04006e30).stop 2020-11-20T11:50:50.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.066+0000 7f0f18e19700 1 -- 172.21.15.164:0/344457074 shutdown_connections 2020-11-20T11:50:50.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.066+0000 7f0f18e19700 1 --2- 172.21.15.164:0/344457074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140bf9a0 0x7f0f140bfd80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.066+0000 7f0f18e19700 1 -- 172.21.15.164:0/344457074 >> 172.21.15.164:0/344457074 conn(0x7f0f140678e0 msgr2=0x7f0f14067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:50.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.066+0000 7f0f18e19700 1 -- 172.21.15.164:0/344457074 shutdown_connections 2020-11-20T11:50:50.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.066+0000 7f0f18e19700 1 -- 172.21.15.164:0/344457074 wait complete. 2020-11-20T11:50:50.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.067+0000 7f0f18e19700 1 Processor -- start 2020-11-20T11:50:50.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.067+0000 7f0f18e19700 1 -- start start 2020-11-20T11:50:50.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.067+0000 7f0f18e19700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f140bf9a0 0x7f0f14149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:50.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.067+0000 7f0f18e19700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140c0bb0 0x7f0f1414a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:50.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.067+0000 7f0f18e19700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f140c49b0 0x7f0f140c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:50.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.067+0000 7f0f18e19700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14154db0 con 0x7f0f140c49b0 2020-11-20T11:50:50.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.067+0000 7f0f18e19700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14155010 con 0x7f0f140c0bb0 2020-11-20T11:50:50.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.067+0000 7f0f18e19700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f141552b0 con 0x7f0f140bf9a0 2020-11-20T11:50:50.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0bfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140c0bb0 0x7f0f1414a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:50.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0bfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140c0bb0 0x7f0f1414a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45880/0 (socket says 172.21.15.164:45880) 2020-11-20T11:50:50.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0bfff700 1 -- 172.21.15.164:0/2395115220 learned_addr learned my addr 172.21.15.164:0/2395115220 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:50.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f12d9d700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f140c49b0 0x7f0f140c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:50.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f1259c700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f140bf9a0 0x7f0f14149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:50.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0bfff700 1 -- 172.21.15.164:0/2395115220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f140bf9a0 msgr2=0x7f0f14149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0bfff700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f140bf9a0 0x7f0f14149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0bfff700 1 -- 172.21.15.164:0/2395115220 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f140c49b0 msgr2=0x7f0f140c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0bfff700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f140c49b0 0x7f0f140c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0bfff700 1 -- 172.21.15.164:0/2395115220 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14153110 con 0x7f0f140c0bb0 2020-11-20T11:50:50.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0bfff700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140c0bb0 0x7f0f1414a350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0efc00c7c0 tx=0x7f0efc007b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:50.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0a7fc700 1 -- 172.21.15.164:0/2395115220 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc007320 con 0x7f0f140c0bb0 2020-11-20T11:50:50.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0a7fc700 1 -- 172.21.15.164:0/2395115220 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc007480 con 0x7f0f140c0bb0 2020-11-20T11:50:50.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f18e19700 1 -- 172.21.15.164:0/2395115220 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f141533b0 con 0x7f0f140c0bb0 2020-11-20T11:50:50.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f0a7fc700 1 -- 172.21.15.164:0/2395115220 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc005840 con 0x7f0f140c0bb0 2020-11-20T11:50:50.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.068+0000 7f0f18e19700 1 -- 172.21.15.164:0/2395115220 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1414a840 con 0x7f0f140c0bb0 2020-11-20T11:50:50.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.069+0000 7f0f18e19700 1 -- 172.21.15.164:0/2395115220 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f140c8690 con 0x7f0f140c0bb0 2020-11-20T11:50:50.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.070+0000 7f0f0a7fc700 1 -- 172.21.15.164:0/2395115220 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0efc010030 con 0x7f0f140c0bb0 2020-11-20T11:50:50.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.070+0000 7f0f0a7fc700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0ef00806a0 0x7f0ef0082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:50.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.070+0000 7f0f0a7fc700 1 -- 172.21.15.164:0/2395115220 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f0efc0a2df0 con 0x7f0f140c0bb0 2020-11-20T11:50:50.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.070+0000 7f0f1259c700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0ef00806a0 0x7f0ef0082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:50.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.071+0000 7f0f1259c700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0ef00806a0 0x7f0ef0082b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0f0400b150 tx=0x7f0f04015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:50.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.073+0000 7f0f0a7fc700 1 -- 172.21.15.164:0/2395115220 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0efc077800 con 0x7f0f140c0bb0 2020-11-20T11:50:50.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.207+0000 7f0f18e19700 1 -- 172.21.15.164:0/2395115220 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f14153810 con 0x7f0ef00806a0 2020-11-20T11:50:50.670 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.211+0000 7f0f0a7fc700 1 -- 172.21.15.164:0/2395115220 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+100798 (secure 0 0 0) 0x7f0f14153810 con 0x7f0ef00806a0 2020-11-20T11:50:50.671 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 -- 172.21.15.164:0/2395115220 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0ef00806a0 msgr2=0x7f0ef0082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.671 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0ef00806a0 0x7f0ef0082b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0f0400b150 tx=0x7f0f04015000).stop 2020-11-20T11:50:50.671 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 -- 172.21.15.164:0/2395115220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140c0bb0 msgr2=0x7f0f1414a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.671 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140c0bb0 0x7f0f1414a350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0efc00c7c0 tx=0x7f0efc007b00).stop 2020-11-20T11:50:50.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 -- 172.21.15.164:0/2395115220 shutdown_connections 2020-11-20T11:50:50.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0ef00806a0 0x7f0ef0082b60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f140c49b0 0x7f0f140c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f140bf9a0 0x7f0f14149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.672 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 --2- 172.21.15.164:0/2395115220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f140c0bb0 0x7f0f1414a350 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.673 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 -- 172.21.15.164:0/2395115220 >> 172.21.15.164:0/2395115220 conn(0x7f0f140678e0 msgr2=0x7f0f140c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:50.673 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 -- 172.21.15.164:0/2395115220 shutdown_connections 2020-11-20T11:50:50.673 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.213+0000 7f0f18e19700 1 -- 172.21.15.164:0/2395115220 wait complete. 2020-11-20T11:50:50.673 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2020-11-20T11:50:50.674 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:50.674 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2020-11-20T11:50:50.094396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":61920,"kb_used_data":3520,"kb_used_omap":0,"kb_used_meta":58304,"kb_avail":1132400160,"statfs":{"total":1159641169920,"available":1159577763840,"internally_reserved":0,"allocated":3604480,"data_stored":1636260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":59703296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.479267"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.390977+0000","last_change":"2020-11-20T11:50:39.389929+0000","last_active":"2020-11-20T11:50:39.390977+0000","last_peered":"2020-11-20T11:50:39.390977+0000","last_clean":"2020-11-20T11:50:39.390977+0000","last_became_active":"2020-11-20T11:50:39.389230+0000","last_became_peered":"2020-11-20T11:50:39.389230+0000","last_unstale":"2020-11-20T11:50:39.390977+0000","last_undegraded":"2020-11-20T11:50:39.390977+0000","last_fullsized":"2020-11-20T11:50:39.390977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,0],"acting":[9,10,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.313704+0000","last_change":"2020-11-20T11:50:33.149836+0000","last_active":"2020-11-20T11:50:39.313704+0000","last_peered":"2020-11-20T11:50:39.313704+0000","last_clean":"2020-11-20T11:50:39.313704+0000","last_became_active":"2020-11-20T11:50:33.149402+0000","last_became_peered":"2020-11-20T11:50:33.149402+0000","last_unstale":"2020-11-20T11:50:39.313704+0000","last_undegraded":"2020-11-20T11:50:39.313704+0000","last_fullsized":"2020-11-20T11:50:39.313704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.634927+0000","last_change":"2020-11-20T11:50:36.273858+0000","last_active":"2020-11-20T11:50:39.634927+0000","last_peered":"2020-11-20T11:50:39.634927+0000","last_clean":"2020-11-20T11:50:39.634927+0000","last_became_active":"2020-11-20T11:50:36.273570+0000","last_became_peered":"2020-11-20T11:50:36.273570+0000","last_unstale":"2020-11-20T11:50:39.634927+0000","last_undegraded":"2020-11-20T11:50:39.634927+0000","last_fullsized":"2020-11-20T11:50:39.634927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.281668+0000","last_change":"2020-11-20T11:50:39.280178+0000","last_active":"2020-11-20T11:50:39.281668+0000","last_peered":"2020-11-20T11:50:39.281668+0000","last_clean":"2020-11-20T11:50:39.281668+0000","last_became_active":"2020-11-20T11:50:39.279495+0000","last_became_peered":"2020-11-20T11:50:39.279495+0000","last_unstale":"2020-11-20T11:50:39.281668+0000","last_undegraded":"2020-11-20T11:50:39.281668+0000","last_fullsized":"2020-11-20T11:50:39.281668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,6],"acting":[8,2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270526+0000","last_change":"2020-11-20T11:50:33.144081+0000","last_active":"2020-11-20T11:50:39.270526+0000","last_peered":"2020-11-20T11:50:39.270526+0000","last_clean":"2020-11-20T11:50:39.270526+0000","last_became_active":"2020-11-20T11:50:33.143591+0000","last_became_peered":"2020-11-20T11:50:33.143591+0000","last_unstale":"2020-11-20T11:50:39.270526+0000","last_undegraded":"2020-11-20T11:50:39.270526+0000","last_fullsized":"2020-11-20T11:50:39.270526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.630056+0000","last_change":"2020-11-20T11:50:36.456248+0000","last_active":"2020-11-20T11:50:39.630056+0000","last_peered":"2020-11-20T11:50:39.630056+0000","last_clean":"2020-11-20T11:50:39.630056+0000","last_became_active":"2020-11-20T11:50:36.455930+0000","last_became_peered":"2020-11-20T11:50:36.455930+0000","last_unstale":"2020-11-20T11:50:39.630056+0000","last_undegraded":"2020-11-20T11:50:39.630056+0000","last_fullsized":"2020-11-20T11:50:39.630056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.280208+0000","last_change":"2020-11-20T11:50:39.278909+0000","last_active":"2020-11-20T11:50:39.280208+0000","last_peered":"2020-11-20T11:50:39.280208+0000","last_clean":"2020-11-20T11:50:39.280208+0000","last_became_active":"2020-11-20T11:50:39.278305+0000","last_became_peered":"2020-11-20T11:50:39.278305+0000","last_unstale":"2020-11-20T11:50:39.280208+0000","last_undegraded":"2020-11-20T11:50:39.280208+0000","last_fullsized":"2020-11-20T11:50:39.280208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,8,9],"acting":[2,0,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.273540+0000","last_change":"2020-11-20T11:50:33.149828+0000","last_active":"2020-11-20T11:50:39.273540+0000","last_peered":"2020-11-20T11:50:39.273540+0000","last_clean":"2020-11-20T11:50:39.273540+0000","last_became_active":"2020-11-20T11:50:33.149428+0000","last_became_peered":"2020-11-20T11:50:33.149428+0000","last_unstale":"2020-11-20T11:50:39.273540+0000","last_undegraded":"2020-11-20T11:50:39.273540+0000","last_fullsized":"2020-11-20T11:50:39.273540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.629095+0000","last_change":"2020-11-20T11:50:37.249871+0000","last_active":"2020-11-20T11:50:39.629095+0000","last_peered":"2020-11-20T11:50:39.629095+0000","last_clean":"2020-11-20T11:50:39.629095+0000","last_became_active":"2020-11-20T11:50:37.249478+0000","last_became_peered":"2020-11-20T11:50:37.249478+0000","last_unstale":"2020-11-20T11:50:39.629095+0000","last_undegraded":"2020-11-20T11:50:39.629095+0000","last_fullsized":"2020-11-20T11:50:39.629095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.318110+0000","last_change":"2020-11-20T11:50:39.315989+0000","last_active":"2020-11-20T11:50:39.318110+0000","last_peered":"2020-11-20T11:50:39.318110+0000","last_clean":"2020-11-20T11:50:39.318110+0000","last_became_active":"2020-11-20T11:50:39.315322+0000","last_became_peered":"2020-11-20T11:50:39.315322+0000","last_unstale":"2020-11-20T11:50:39.318110+0000","last_undegraded":"2020-11-20T11:50:39.318110+0000","last_fullsized":"2020-11-20T11:50:39.318110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1,3],"acting":[7,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.312978+0000","last_change":"2020-11-20T11:50:33.453134+0000","last_active":"2020-11-20T11:50:39.312978+0000","last_peered":"2020-11-20T11:50:39.312978+0000","last_clean":"2020-11-20T11:50:39.312978+0000","last_became_active":"2020-11-20T11:50:33.452821+0000","last_became_peered":"2020-11-20T11:50:33.452821+0000","last_unstale":"2020-11-20T11:50:39.312978+0000","last_undegraded":"2020-11-20T11:50:39.312978+0000","last_fullsized":"2020-11-20T11:50:39.312978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270532+0000","last_change":"2020-11-20T11:50:28.351977+0000","last_active":"2020-11-20T11:50:39.270532+0000","last_peered":"2020-11-20T11:50:39.270532+0000","last_clean":"2020-11-20T11:50:39.270532+0000","last_became_active":"2020-11-20T11:50:28.351248+0000","last_became_peered":"2020-11-20T11:50:28.351248+0000","last_unstale":"2020-11-20T11:50:39.270532+0000","last_undegraded":"2020-11-20T11:50:39.270532+0000","last_fullsized":"2020-11-20T11:50:39.270532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:22.155217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:22.155217+0000","last_clean_scrub_stamp":"2020-11-20T11:50:22.155217+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"13","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.621397+0000","last_change":"2020-11-20T11:50:36.274590+0000","last_active":"2020-11-20T11:50:39.621397+0000","last_peered":"2020-11-20T11:50:39.621397+0000","last_clean":"2020-11-20T11:50:39.621397+0000","last_became_active":"2020-11-20T11:50:36.274158+0000","last_became_peered":"2020-11-20T11:50:36.274158+0000","last_unstale":"2020-11-20T11:50:39.621397+0000","last_undegraded":"2020-11-20T11:50:39.621397+0000","last_fullsized":"2020-11-20T11:50:39.621397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.391229+0000","last_change":"2020-11-20T11:50:39.390204+0000","last_active":"2020-11-20T11:50:39.391229+0000","last_peered":"2020-11-20T11:50:39.391229+0000","last_clean":"2020-11-20T11:50:39.391229+0000","last_became_active":"2020-11-20T11:50:39.389493+0000","last_became_peered":"2020-11-20T11:50:39.389493+0000","last_unstale":"2020-11-20T11:50:39.391229+0000","last_undegraded":"2020-11-20T11:50:39.391229+0000","last_fullsized":"2020-11-20T11:50:39.391229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2,10],"acting":[9,8,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270533+0000","last_change":"2020-11-20T11:50:33.144765+0000","last_active":"2020-11-20T11:50:39.270533+0000","last_peered":"2020-11-20T11:50:39.270533+0000","last_clean":"2020-11-20T11:50:39.270533+0000","last_became_active":"2020-11-20T11:50:33.144316+0000","last_became_peered":"2020-11-20T11:50:33.144316+0000","last_unstale":"2020-11-20T11:50:39.270533+0000","last_undegraded":"2020-11-20T11:50:39.270533+0000","last_fullsized":"2020-11-20T11:50:39.270533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.313666+0000","last_change":"2020-11-20T11:50:36.456553+0000","last_active":"2020-11-20T11:50:39.313666+0000","last_peered":"2020-11-20T11:50:39.313666+0000","last_clean":"2020-11-20T11:50:39.313666+0000","last_became_active":"2020-11-20T11:50:36.456244+0000","last_became_peered":"2020-11-20T11:50:36.456244+0000","last_unstale":"2020-11-20T11:50:39.313666+0000","last_undegraded":"2020-11-20T11:50:39.313666+0000","last_fullsized":"2020-11-20T11:50:39.313666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.317263+0000","last_change":"2020-11-20T11:50:39.316003+0000","last_active":"2020-11-20T11:50:39.317263+0000","last_peered":"2020-11-20T11:50:39.317263+0000","last_clean":"2020-11-20T11:50:39.317263+0000","last_became_active":"2020-11-20T11:50:39.315185+0000","last_became_peered":"2020-11-20T11:50:39.315185+0000","last_unstale":"2020-11-20T11:50:39.317263+0000","last_undegraded":"2020-11-20T11:50:39.317263+0000","last_fullsized":"2020-11-20T11:50:39.317263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,11],"acting":[0,2,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.313009+0000","last_change":"2020-11-20T11:50:33.146356+0000","last_active":"2020-11-20T11:50:39.313009+0000","last_peered":"2020-11-20T11:50:39.313009+0000","last_clean":"2020-11-20T11:50:39.313009+0000","last_became_active":"2020-11-20T11:50:33.146090+0000","last_became_peered":"2020-11-20T11:50:33.146090+0000","last_unstale":"2020-11-20T11:50:39.313009+0000","last_undegraded":"2020-11-20T11:50:39.313009+0000","last_fullsized":"2020-11-20T11:50:39.313009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.631760+0000","last_change":"2020-11-20T11:50:36.274051+0000","last_active":"2020-11-20T11:50:39.631760+0000","last_peered":"2020-11-20T11:50:39.631760+0000","last_clean":"2020-11-20T11:50:39.631760+0000","last_became_active":"2020-11-20T11:50:36.273653+0000","last_became_peered":"2020-11-20T11:50:36.273653+0000","last_unstale":"2020-11-20T11:50:39.631760+0000","last_undegraded":"2020-11-20T11:50:39.631760+0000","last_fullsized":"2020-11-20T11:50:39.631760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.391505+0000","last_change":"2020-11-20T11:50:39.390131+0000","last_active":"2020-11-20T11:50:39.391505+0000","last_peered":"2020-11-20T11:50:39.391505+0000","last_clean":"2020-11-20T11:50:39.391505+0000","last_became_active":"2020-11-20T11:50:39.389272+0000","last_became_peered":"2020-11-20T11:50:39.389272+0000","last_unstale":"2020-11-20T11:50:39.391505+0000","last_undegraded":"2020-11-20T11:50:39.391505+0000","last_fullsized":"2020-11-20T11:50:39.391505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,11,7],"acting":[5,10,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.628571+0000","last_change":"2020-11-20T11:50:37.249008+0000","last_active":"2020-11-20T11:50:39.628571+0000","last_peered":"2020-11-20T11:50:39.628571+0000","last_clean":"2020-11-20T11:50:39.628571+0000","last_became_active":"2020-11-20T11:50:37.248661+0000","last_became_peered":"2020-11-20T11:50:37.248661+0000","last_unstale":"2020-11-20T11:50:39.628571+0000","last_undegraded":"2020-11-20T11:50:39.628571+0000","last_fullsized":"2020-11-20T11:50:39.628571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.271281+0000","last_change":"2020-11-20T11:50:33.395499+0000","last_active":"2020-11-20T11:50:39.271281+0000","last_peered":"2020-11-20T11:50:39.271281+0000","last_clean":"2020-11-20T11:50:39.271281+0000","last_became_active":"2020-11-20T11:50:33.395209+0000","last_became_peered":"2020-11-20T11:50:33.395209+0000","last_unstale":"2020-11-20T11:50:39.271281+0000","last_undegraded":"2020-11-20T11:50:39.271281+0000","last_fullsized":"2020-11-20T11:50:39.271281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.315786+0000","last_change":"2020-11-20T11:50:39.315204+0000","last_active":"2020-11-20T11:50:39.315786+0000","last_peered":"2020-11-20T11:50:39.315786+0000","last_clean":"2020-11-20T11:50:39.315786+0000","last_became_active":"2020-11-20T11:50:39.314678+0000","last_became_peered":"2020-11-20T11:50:39.314678+0000","last_unstale":"2020-11-20T11:50:39.315786+0000","last_undegraded":"2020-11-20T11:50:39.315786+0000","last_fullsized":"2020-11-20T11:50:39.315786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,7],"acting":[6,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.312979+0000","last_change":"2020-11-20T11:50:33.395626+0000","last_active":"2020-11-20T11:50:39.312979+0000","last_peered":"2020-11-20T11:50:39.312979+0000","last_clean":"2020-11-20T11:50:39.312979+0000","last_became_active":"2020-11-20T11:50:33.395281+0000","last_became_peered":"2020-11-20T11:50:33.395281+0000","last_unstale":"2020-11-20T11:50:39.312979+0000","last_undegraded":"2020-11-20T11:50:39.312979+0000","last_fullsized":"2020-11-20T11:50:39.312979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'4","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.631417+0000","last_change":"2020-11-20T11:50:36.274786+0000","last_active":"2020-11-20T11:50:39.631417+0000","last_peered":"2020-11-20T11:50:39.631417+0000","last_clean":"2020-11-20T11:50:39.631417+0000","last_became_active":"2020-11-20T11:50:36.274438+0000","last_became_peered":"2020-11-20T11:50:36.274438+0000","last_unstale":"2020-11-20T11:50:39.631417+0000","last_undegraded":"2020-11-20T11:50:39.631417+0000","last_fullsized":"2020-11-20T11:50:39.631417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5649999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":136165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.845}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]}]},{"osd":9,"up_from":17,"seq":73014444038,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.95}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0430000000000001}]}]},{"osd":8,"up_from":17,"seq":73014444038,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":137666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6379999999999999}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.873}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]}]},{"osd":6,"up_from":17,"seq":73014444038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]}]},{"osd":1,"up_from":17,"seq":73014444039,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5096,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366744,"statfs":{"total":96636764160,"available":96631545856,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.748}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.954}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9339999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1000000000000001}]}]},{"osd":0,"up_from":17,"seq":73014444038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.788}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8180000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.962}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]}]},{"osd":3,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":137506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":299008,"data_stored":136005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8939999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]}]}]}} 2020-11-20T11:50:50.716 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:50:50.831 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.827+0000 7f60e2619700 1 Processor -- start 2020-11-20T11:50:50.831 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.827+0000 7f60e2619700 1 -- start start 2020-11-20T11:50:50.833 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60e2619700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f60dc0bf9a0 0x7f60dc0bfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:50.833 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60e2619700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60dc1516d0 con 0x7f60dc0c0bb0 2020-11-20T11:50:50.834 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60e2619700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60dc151970 con 0x7f60dc0c49b0 2020-11-20T11:50:50.834 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60e2619700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60dc151c10 con 0x7f60dc0bf9a0 2020-11-20T11:50:50.834 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60dbfff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f60dc0bf9a0 0x7f60dc0bfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:50.834 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60dbfff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f60dc0bf9a0 0x7f60dc0bfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45886/0 (socket says 172.21.15.164:45886) 2020-11-20T11:50:50.834 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60dbfff700 1 -- 172.21.15.164:0/1765665626 learned_addr learned my addr 172.21.15.164:0/1765665626 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:50.835 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60dbfff700 1 -- 172.21.15.164:0/1765665626 >> v1:172.21.15.188:6789/0 conn(0x7f60dc0c49b0 legacy=0x7f60dc150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:50.835 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60dbfff700 1 -- 172.21.15.164:0/1765665626 >> v1:172.21.15.36:6789/0 conn(0x7f60dc0c0bb0 legacy=0x7f60dc0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:50.835 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60dbfff700 1 -- 172.21.15.164:0/1765665626 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc151eb0 con 0x7f60dc0bf9a0 2020-11-20T11:50:50.835 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.828+0000 7f60dbfff700 1 --2- 172.21.15.164:0/1765665626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc0bf9a0 0x7f60dc0bfd80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f60cc009a10 tx=0x7f60cc006ef0).ready entity=mon.1 client_cookie=ef04b264fea90781 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:50.835 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.829+0000 7f60daffd700 1 -- 172.21.15.164:0/1765665626 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00b7e0 con 0x7f60dc0bf9a0 2020-11-20T11:50:50.836 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.829+0000 7f60daffd700 1 -- 172.21.15.164:0/1765665626 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc000e90 con 0x7f60dc0bf9a0 2020-11-20T11:50:50.836 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.829+0000 7f60daffd700 1 -- 172.21.15.164:0/1765665626 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00bb50 con 0x7f60dc0bf9a0 2020-11-20T11:50:50.836 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.829+0000 7f60e2619700 1 -- 172.21.15.164:0/1765665626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc0bf9a0 msgr2=0x7f60dc0bfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.836 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.829+0000 7f60e2619700 1 --2- 172.21.15.164:0/1765665626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc0bf9a0 0x7f60dc0bfd80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f60cc009a10 tx=0x7f60cc006ef0).stop 2020-11-20T11:50:50.836 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.829+0000 7f60e2619700 1 -- 172.21.15.164:0/1765665626 shutdown_connections 2020-11-20T11:50:50.837 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.829+0000 7f60e2619700 1 --2- 172.21.15.164:0/1765665626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc0bf9a0 0x7f60dc0bfd80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.837 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.829+0000 7f60e2619700 1 -- 172.21.15.164:0/1765665626 >> 172.21.15.164:0/1765665626 conn(0x7f60dc0678e0 msgr2=0x7f60dc067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:50.837 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.829+0000 7f60e2619700 1 -- 172.21.15.164:0/1765665626 shutdown_connections 2020-11-20T11:50:50.837 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.829+0000 7f60e2619700 1 -- 172.21.15.164:0/1765665626 wait complete. 2020-11-20T11:50:50.839 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.830+0000 7f60e2619700 1 Processor -- start 2020-11-20T11:50:50.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.830+0000 7f60e2619700 1 -- start start 2020-11-20T11:50:50.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60e2619700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60dc0c0bb0 0x7f60dc161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:50.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60e2619700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f60dc0c49b0 0x7f60dc164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:50.840 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60e2619700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc149b40 0x7f60dc160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:50.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60e2619700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc0c6c00 con 0x7f60dc0c0bb0 2020-11-20T11:50:50.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60e2619700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc0c7590 con 0x7f60dc149b40 2020-11-20T11:50:50.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60e2619700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc164930 con 0x7f60dc0c49b0 2020-11-20T11:50:50.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60e0bb6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc149b40 0x7f60dc160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:50.841 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60e0bb6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc149b40 0x7f60dc160dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45896/0 (socket says 172.21.15.164:45896) 2020-11-20T11:50:50.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60e0bb6700 1 -- 172.21.15.164:0/1907706805 learned_addr learned my addr 172.21.15.164:0/1907706805 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:50.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60db7fe700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f60dc0c49b0 0x7f60dc164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:50.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.831+0000 7f60dbfff700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60dc0c0bb0 0x7f60dc161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:50.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60e0bb6700 1 -- 172.21.15.164:0/1907706805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f60dc0c49b0 msgr2=0x7f60dc164440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.842 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60e0bb6700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f60dc0c49b0 0x7f60dc164440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60e0bb6700 1 -- 172.21.15.164:0/1907706805 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60dc0c0bb0 msgr2=0x7f60dc161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60e0bb6700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60dc0c0bb0 0x7f60dc161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60e0bb6700 1 -- 172.21.15.164:0/1907706805 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0c6df0 con 0x7f60dc149b40 2020-11-20T11:50:50.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60e0bb6700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc149b40 0x7f60dc160dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f60d400bae0 tx=0x7f60d4009120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:50.843 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60bbfff700 1 -- 172.21.15.164:0/1907706805 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400c640 con 0x7f60dc149b40 2020-11-20T11:50:50.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60bbfff700 1 -- 172.21.15.164:0/1907706805 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d400c7c0 con 0x7f60dc149b40 2020-11-20T11:50:50.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60e2619700 1 -- 172.21.15.164:0/1907706805 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60dc0c7050 con 0x7f60dc149b40 2020-11-20T11:50:50.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60bbfff700 1 -- 172.21.15.164:0/1907706805 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400c970 con 0x7f60dc149b40 2020-11-20T11:50:50.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.832+0000 7f60e2619700 1 -- 172.21.15.164:0/1907706805 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60dc160680 con 0x7f60dc149b40 2020-11-20T11:50:50.844 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.833+0000 7f60e2619700 1 -- 172.21.15.164:0/1907706805 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60dc069b70 con 0x7f60dc149b40 2020-11-20T11:50:50.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.834+0000 7f60bbfff700 1 -- 172.21.15.164:0/1907706805 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f60d401c070 con 0x7f60dc149b40 2020-11-20T11:50:50.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.834+0000 7f60bbfff700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f60b4080670 0x7f60b4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:50.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.834+0000 7f60bbfff700 1 -- 172.21.15.164:0/1907706805 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f60d40a2420 con 0x7f60dc149b40 2020-11-20T11:50:50.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.834+0000 7f60dbfff700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f60b4080670 0x7f60b4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:50.845 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.834+0000 7f60dbfff700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f60b4080670 0x7f60b4082b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f60dc063020 tx=0x7f60cc016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:50.846 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.837+0000 7f60bbfff700 1 -- 172.21.15.164:0/1907706805 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f60d4076e30 con 0x7f60dc149b40 2020-11-20T11:50:50.975 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.972+0000 7f60e2619700 1 -- 172.21.15.164:0/1907706805 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60dc0c8510 con 0x7f60b4080670 2020-11-20T11:50:50.979 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.976+0000 7f60bbfff700 1 -- 172.21.15.164:0/1907706805 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+100798 (secure 0 0 0) 0x7f60dc0c8510 con 0x7f60b4080670 2020-11-20T11:50:50.981 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:50.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 -- 172.21.15.164:0/1907706805 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f60b4080670 msgr2=0x7f60b4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f60b4080670 0x7f60b4082b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f60dc063020 tx=0x7f60cc016000).stop 2020-11-20T11:50:50.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 -- 172.21.15.164:0/1907706805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc149b40 msgr2=0x7f60dc160dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:50.982 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc149b40 0x7f60dc160dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f60d400bae0 tx=0x7f60d4009120).stop 2020-11-20T11:50:50.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 -- 172.21.15.164:0/1907706805 shutdown_connections 2020-11-20T11:50:50.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f60b4080670 0x7f60b4082b30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60dc149b40 0x7f60dc160dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60dc0c0bb0 0x7f60dc161960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.983 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 --2- 172.21.15.164:0/1907706805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f60dc0c49b0 0x7f60dc164440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:50.984 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 -- 172.21.15.164:0/1907706805 >> 172.21.15.164:0/1907706805 conn(0x7f60dc0678e0 msgr2=0x7f60dc14ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:50.984 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 -- 172.21.15.164:0/1907706805 shutdown_connections 2020-11-20T11:50:50.984 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:50.978+0000 7f60e2619700 1 -- 172.21.15.164:0/1907706805 wait complete. 2020-11-20T11:50:50.984 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2020-11-20T11:50:50.993 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2020-11-20T11:50:50.094396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":61920,"kb_used_data":3520,"kb_used_omap":0,"kb_used_meta":58304,"kb_avail":1132400160,"statfs":{"total":1159641169920,"available":1159577763840,"internally_reserved":0,"allocated":3604480,"data_stored":1636260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":59703296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.479267"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.390977+0000","last_change":"2020-11-20T11:50:39.389929+0000","last_active":"2020-11-20T11:50:39.390977+0000","last_peered":"2020-11-20T11:50:39.390977+0000","last_clean":"2020-11-20T11:50:39.390977+0000","last_became_active":"2020-11-20T11:50:39.389230+0000","last_became_peered":"2020-11-20T11:50:39.389230+0000","last_unstale":"2020-11-20T11:50:39.390977+0000","last_undegraded":"2020-11-20T11:50:39.390977+0000","last_fullsized":"2020-11-20T11:50:39.390977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,0],"acting":[9,10,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.313704+0000","last_change":"2020-11-20T11:50:33.149836+0000","last_active":"2020-11-20T11:50:39.313704+0000","last_peered":"2020-11-20T11:50:39.313704+0000","last_clean":"2020-11-20T11:50:39.313704+0000","last_became_active":"2020-11-20T11:50:33.149402+0000","last_became_peered":"2020-11-20T11:50:33.149402+0000","last_unstale":"2020-11-20T11:50:39.313704+0000","last_undegraded":"2020-11-20T11:50:39.313704+0000","last_fullsized":"2020-11-20T11:50:39.313704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.634927+0000","last_change":"2020-11-20T11:50:36.273858+0000","last_active":"2020-11-20T11:50:39.634927+0000","last_peered":"2020-11-20T11:50:39.634927+0000","last_clean":"2020-11-20T11:50:39.634927+0000","last_became_active":"2020-11-20T11:50:36.273570+0000","last_became_peered":"2020-11-20T11:50:36.273570+0000","last_unstale":"2020-11-20T11:50:39.634927+0000","last_undegraded":"2020-11-20T11:50:39.634927+0000","last_fullsized":"2020-11-20T11:50:39.634927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.281668+0000","last_change":"2020-11-20T11:50:39.280178+0000","last_active":"2020-11-20T11:50:39.281668+0000","last_peered":"2020-11-20T11:50:39.281668+0000","last_clean":"2020-11-20T11:50:39.281668+0000","last_became_active":"2020-11-20T11:50:39.279495+0000","last_became_peered":"2020-11-20T11:50:39.279495+0000","last_unstale":"2020-11-20T11:50:39.281668+0000","last_undegraded":"2020-11-20T11:50:39.281668+0000","last_fullsized":"2020-11-20T11:50:39.281668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,6],"acting":[8,2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270526+0000","last_change":"2020-11-20T11:50:33.144081+0000","last_active":"2020-11-20T11:50:39.270526+0000","last_peered":"2020-11-20T11:50:39.270526+0000","last_clean":"2020-11-20T11:50:39.270526+0000","last_became_active":"2020-11-20T11:50:33.143591+0000","last_became_peered":"2020-11-20T11:50:33.143591+0000","last_unstale":"2020-11-20T11:50:39.270526+0000","last_undegraded":"2020-11-20T11:50:39.270526+0000","last_fullsized":"2020-11-20T11:50:39.270526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.630056+0000","last_change":"2020-11-20T11:50:36.456248+0000","last_active":"2020-11-20T11:50:39.630056+0000","last_peered":"2020-11-20T11:50:39.630056+0000","last_clean":"2020-11-20T11:50:39.630056+0000","last_became_active":"2020-11-20T11:50:36.455930+0000","last_became_peered":"2020-11-20T11:50:36.455930+0000","last_unstale":"2020-11-20T11:50:39.630056+0000","last_undegraded":"2020-11-20T11:50:39.630056+0000","last_fullsized":"2020-11-20T11:50:39.630056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.280208+0000","last_change":"2020-11-20T11:50:39.278909+0000","last_active":"2020-11-20T11:50:39.280208+0000","last_peered":"2020-11-20T11:50:39.280208+0000","last_clean":"2020-11-20T11:50:39.280208+0000","last_became_active":"2020-11-20T11:50:39.278305+0000","last_became_peered":"2020-11-20T11:50:39.278305+0000","last_unstale":"2020-11-20T11:50:39.280208+0000","last_undegraded":"2020-11-20T11:50:39.280208+0000","last_fullsized":"2020-11-20T11:50:39.280208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,8,9],"acting":[2,0,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.273540+0000","last_change":"2020-11-20T11:50:33.149828+0000","last_active":"2020-11-20T11:50:39.273540+0000","last_peered":"2020-11-20T11:50:39.273540+0000","last_clean":"2020-11-20T11:50:39.273540+0000","last_became_active":"2020-11-20T11:50:33.149428+0000","last_became_peered":"2020-11-20T11:50:33.149428+0000","last_unstale":"2020-11-20T11:50:39.273540+0000","last_undegraded":"2020-11-20T11:50:39.273540+0000","last_fullsized":"2020-11-20T11:50:39.273540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.629095+0000","last_change":"2020-11-20T11:50:37.249871+0000","last_active":"2020-11-20T11:50:39.629095+0000","last_peered":"2020-11-20T11:50:39.629095+0000","last_clean":"2020-11-20T11:50:39.629095+0000","last_became_active":"2020-11-20T11:50:37.249478+0000","last_became_peered":"2020-11-20T11:50:37.249478+0000","last_unstale":"2020-11-20T11:50:39.629095+0000","last_undegraded":"2020-11-20T11:50:39.629095+0000","last_fullsized":"2020-11-20T11:50:39.629095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.318110+0000","last_change":"2020-11-20T11:50:39.315989+0000","last_active":"2020-11-20T11:50:39.318110+0000","last_peered":"2020-11-20T11:50:39.318110+0000","last_clean":"2020-11-20T11:50:39.318110+0000","last_became_active":"2020-11-20T11:50:39.315322+0000","last_became_peered":"2020-11-20T11:50:39.315322+0000","last_unstale":"2020-11-20T11:50:39.318110+0000","last_undegraded":"2020-11-20T11:50:39.318110+0000","last_fullsized":"2020-11-20T11:50:39.318110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1,3],"acting":[7,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.312978+0000","last_change":"2020-11-20T11:50:33.453134+0000","last_active":"2020-11-20T11:50:39.312978+0000","last_peered":"2020-11-20T11:50:39.312978+0000","last_clean":"2020-11-20T11:50:39.312978+0000","last_became_active":"2020-11-20T11:50:33.452821+0000","last_became_peered":"2020-11-20T11:50:33.452821+0000","last_unstale":"2020-11-20T11:50:39.312978+0000","last_undegraded":"2020-11-20T11:50:39.312978+0000","last_fullsized":"2020-11-20T11:50:39.312978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270532+0000","last_change":"2020-11-20T11:50:28.351977+0000","last_active":"2020-11-20T11:50:39.270532+0000","last_peered":"2020-11-20T11:50:39.270532+0000","last_clean":"2020-11-20T11:50:39.270532+0000","last_became_active":"2020-11-20T11:50:28.351248+0000","last_became_peered":"2020-11-20T11:50:28.351248+0000","last_unstale":"2020-11-20T11:50:39.270532+0000","last_undegraded":"2020-11-20T11:50:39.270532+0000","last_fullsized":"2020-11-20T11:50:39.270532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:22.155217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:22.155217+0000","last_clean_scrub_stamp":"2020-11-20T11:50:22.155217+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"13","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.621397+0000","last_change":"2020-11-20T11:50:36.274590+0000","last_active":"2020-11-20T11:50:39.621397+0000","last_peered":"2020-11-20T11:50:39.621397+0000","last_clean":"2020-11-20T11:50:39.621397+0000","last_became_active":"2020-11-20T11:50:36.274158+0000","last_became_peered":"2020-11-20T11:50:36.274158+0000","last_unstale":"2020-11-20T11:50:39.621397+0000","last_undegraded":"2020-11-20T11:50:39.621397+0000","last_fullsized":"2020-11-20T11:50:39.621397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.391229+0000","last_change":"2020-11-20T11:50:39.390204+0000","last_active":"2020-11-20T11:50:39.391229+0000","last_peered":"2020-11-20T11:50:39.391229+0000","last_clean":"2020-11-20T11:50:39.391229+0000","last_became_active":"2020-11-20T11:50:39.389493+0000","last_became_peered":"2020-11-20T11:50:39.389493+0000","last_unstale":"2020-11-20T11:50:39.391229+0000","last_undegraded":"2020-11-20T11:50:39.391229+0000","last_fullsized":"2020-11-20T11:50:39.391229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2,10],"acting":[9,8,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270533+0000","last_change":"2020-11-20T11:50:33.144765+0000","last_active":"2020-11-20T11:50:39.270533+0000","last_peered":"2020-11-20T11:50:39.270533+0000","last_clean":"2020-11-20T11:50:39.270533+0000","last_became_active":"2020-11-20T11:50:33.144316+0000","last_became_peered":"2020-11-20T11:50:33.144316+0000","last_unstale":"2020-11-20T11:50:39.270533+0000","last_undegraded":"2020-11-20T11:50:39.270533+0000","last_fullsized":"2020-11-20T11:50:39.270533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.313666+0000","last_change":"2020-11-20T11:50:36.456553+0000","last_active":"2020-11-20T11:50:39.313666+0000","last_peered":"2020-11-20T11:50:39.313666+0000","last_clean":"2020-11-20T11:50:39.313666+0000","last_became_active":"2020-11-20T11:50:36.456244+0000","last_became_peered":"2020-11-20T11:50:36.456244+0000","last_unstale":"2020-11-20T11:50:39.313666+0000","last_undegraded":"2020-11-20T11:50:39.313666+0000","last_fullsized":"2020-11-20T11:50:39.313666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.317263+0000","last_change":"2020-11-20T11:50:39.316003+0000","last_active":"2020-11-20T11:50:39.317263+0000","last_peered":"2020-11-20T11:50:39.317263+0000","last_clean":"2020-11-20T11:50:39.317263+0000","last_became_active":"2020-11-20T11:50:39.315185+0000","last_became_peered":"2020-11-20T11:50:39.315185+0000","last_unstale":"2020-11-20T11:50:39.317263+0000","last_undegraded":"2020-11-20T11:50:39.317263+0000","last_fullsized":"2020-11-20T11:50:39.317263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,11],"acting":[0,2,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.313009+0000","last_change":"2020-11-20T11:50:33.146356+0000","last_active":"2020-11-20T11:50:39.313009+0000","last_peered":"2020-11-20T11:50:39.313009+0000","last_clean":"2020-11-20T11:50:39.313009+0000","last_became_active":"2020-11-20T11:50:33.146090+0000","last_became_peered":"2020-11-20T11:50:33.146090+0000","last_unstale":"2020-11-20T11:50:39.313009+0000","last_undegraded":"2020-11-20T11:50:39.313009+0000","last_fullsized":"2020-11-20T11:50:39.313009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.631760+0000","last_change":"2020-11-20T11:50:36.274051+0000","last_active":"2020-11-20T11:50:39.631760+0000","last_peered":"2020-11-20T11:50:39.631760+0000","last_clean":"2020-11-20T11:50:39.631760+0000","last_became_active":"2020-11-20T11:50:36.273653+0000","last_became_peered":"2020-11-20T11:50:36.273653+0000","last_unstale":"2020-11-20T11:50:39.631760+0000","last_undegraded":"2020-11-20T11:50:39.631760+0000","last_fullsized":"2020-11-20T11:50:39.631760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.391505+0000","last_change":"2020-11-20T11:50:39.390131+0000","last_active":"2020-11-20T11:50:39.391505+0000","last_peered":"2020-11-20T11:50:39.391505+0000","last_clean":"2020-11-20T11:50:39.391505+0000","last_became_active":"2020-11-20T11:50:39.389272+0000","last_became_peered":"2020-11-20T11:50:39.389272+0000","last_unstale":"2020-11-20T11:50:39.391505+0000","last_undegraded":"2020-11-20T11:50:39.391505+0000","last_fullsized":"2020-11-20T11:50:39.391505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,11,7],"acting":[5,10,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.628571+0000","last_change":"2020-11-20T11:50:37.249008+0000","last_active":"2020-11-20T11:50:39.628571+0000","last_peered":"2020-11-20T11:50:39.628571+0000","last_clean":"2020-11-20T11:50:39.628571+0000","last_became_active":"2020-11-20T11:50:37.248661+0000","last_became_peered":"2020-11-20T11:50:37.248661+0000","last_unstale":"2020-11-20T11:50:39.628571+0000","last_undegraded":"2020-11-20T11:50:39.628571+0000","last_fullsized":"2020-11-20T11:50:39.628571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.271281+0000","last_change":"2020-11-20T11:50:33.395499+0000","last_active":"2020-11-20T11:50:39.271281+0000","last_peered":"2020-11-20T11:50:39.271281+0000","last_clean":"2020-11-20T11:50:39.271281+0000","last_became_active":"2020-11-20T11:50:33.395209+0000","last_became_peered":"2020-11-20T11:50:33.395209+0000","last_unstale":"2020-11-20T11:50:39.271281+0000","last_undegraded":"2020-11-20T11:50:39.271281+0000","last_fullsized":"2020-11-20T11:50:39.271281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.315786+0000","last_change":"2020-11-20T11:50:39.315204+0000","last_active":"2020-11-20T11:50:39.315786+0000","last_peered":"2020-11-20T11:50:39.315786+0000","last_clean":"2020-11-20T11:50:39.315786+0000","last_became_active":"2020-11-20T11:50:39.314678+0000","last_became_peered":"2020-11-20T11:50:39.314678+0000","last_unstale":"2020-11-20T11:50:39.315786+0000","last_undegraded":"2020-11-20T11:50:39.315786+0000","last_fullsized":"2020-11-20T11:50:39.315786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,7],"acting":[6,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.312979+0000","last_change":"2020-11-20T11:50:33.395626+0000","last_active":"2020-11-20T11:50:39.312979+0000","last_peered":"2020-11-20T11:50:39.312979+0000","last_clean":"2020-11-20T11:50:39.312979+0000","last_became_active":"2020-11-20T11:50:33.395281+0000","last_became_peered":"2020-11-20T11:50:33.395281+0000","last_unstale":"2020-11-20T11:50:39.312979+0000","last_undegraded":"2020-11-20T11:50:39.312979+0000","last_fullsized":"2020-11-20T11:50:39.312979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'4","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.631417+0000","last_change":"2020-11-20T11:50:36.274786+0000","last_active":"2020-11-20T11:50:39.631417+0000","last_peered":"2020-11-20T11:50:39.631417+0000","last_clean":"2020-11-20T11:50:39.631417+0000","last_became_active":"2020-11-20T11:50:36.274438+0000","last_became_peered":"2020-11-20T11:50:36.274438+0000","last_unstale":"2020-11-20T11:50:39.631417+0000","last_undegraded":"2020-11-20T11:50:39.631417+0000","last_fullsized":"2020-11-20T11:50:39.631417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5649999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":136165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.845}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]}]},{"osd":9,"up_from":17,"seq":73014444038,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.95}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0430000000000001}]}]},{"osd":8,"up_from":17,"seq":73014444038,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":137666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6379999999999999}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.873}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]}]},{"osd":6,"up_from":17,"seq":73014444038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]}]},{"osd":1,"up_from":17,"seq":73014444039,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5096,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366744,"statfs":{"total":96636764160,"available":96631545856,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.748}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.954}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9339999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1000000000000001}]}]},{"osd":0,"up_from":17,"seq":73014444038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.788}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8180000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.962}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]}]},{"osd":3,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":137506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":299008,"data_stored":136005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8939999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]}]}]}} 2020-11-20T11:50:50.998 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-20T11:50:50.999 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-20T11:50:50.999 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-11-20T11:50:50.999 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-11-20T11:50:51.107 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.103+0000 7f213fa23700 1 Processor -- start 2020-11-20T11:50:51.107 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.103+0000 7f213fa23700 1 -- start start 2020-11-20T11:50:51.111 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.104+0000 7f213fa23700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f21380c4740 0x7f21381550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.111 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.104+0000 7f213fa23700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21381555e0 con 0x7f2138150520 2020-11-20T11:50:51.111 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.104+0000 7f213fa23700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2138151220 con 0x7f21380c4360 2020-11-20T11:50:51.111 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.104+0000 7f213fa23700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21380bd090 con 0x7f21380c4740 2020-11-20T11:50:51.111 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.104+0000 7f213d7bf700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f21380c4360 0x7f21380bfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55640/0 (socket says 172.21.15.164:55640) 2020-11-20T11:50:51.112 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.104+0000 7f213d7bf700 1 -- 172.21.15.164:0/1299031563 learned_addr learned my addr 172.21.15.164:0/1299031563 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:51.112 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.104+0000 7f213cfbe700 1 --2- 172.21.15.164:0/1299031563 >> v2:172.21.15.36:3300/0 conn(0x7f21380c4740 0x7f21381550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.112 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.104+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916024245 0 0) 0x7f2138151220 con 0x7f21380c4360 2020-11-20T11:50:51.112 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.104+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2120003280 con 0x7f21380c4360 2020-11-20T11:50:51.113 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028875198 0 0) 0x7f21381555e0 con 0x7f2138150520 2020-11-20T11:50:51.113 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2138151220 con 0x7f2138150520 2020-11-20T11:50:51.113 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 418377900 0 0) 0x7f2120003280 con 0x7f21380c4360 2020-11-20T11:50:51.113 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 >> v2:172.21.15.36:3300/0 conn(0x7f21380c4740 msgr2=0x7f21381550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:51.114 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 --2- 172.21.15.164:0/1299031563 >> v2:172.21.15.36:3300/0 conn(0x7f21380c4740 0x7f21381550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.114 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 >> v1:172.21.15.36:6789/0 conn(0x7f2138150520 legacy=0x7f2138150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.114 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21381514c0 con 0x7f21380c4360 2020-11-20T11:50:51.114 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7f2134001520 con 0x7f21380c4360 2020-11-20T11:50:51.114 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 >> v1:172.21.15.164:6789/0 conn(0x7f21380c4360 legacy=0x7f21380bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.115 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2120003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.115 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2120004520 0x7f21200049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.115 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2120004e90 0x7f212000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.115 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21380bd090 con 0x7f2120004e90 2020-11-20T11:50:51.115 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212000bc60 con 0x7f2120003950 2020-11-20T11:50:51.116 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212000bda0 con 0x7f2120004520 2020-11-20T11:50:51.116 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213d7bf700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2120003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.116 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213dfc0700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2120004e90 0x7f212000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.116 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213cfbe700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2120004520 0x7f21200049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.116 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213d7bf700 1 -- 172.21.15.164:0/1299031563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2120004520 msgr2=0x7f21200049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:51.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213d7bf700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2120004520 0x7f21200049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213d7bf700 1 -- 172.21.15.164:0/1299031563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2120004e90 msgr2=0x7f212000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:51.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213d7bf700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2120004e90 0x7f212000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213d7bf700 1 -- 172.21.15.164:0/1299031563 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120003280 con 0x7f2120003950 2020-11-20T11:50:51.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213dfc0700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2120004e90 0x7f212000b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:51.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213cfbe700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2120004520 0x7f21200049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:51.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213dfc0700 1 -- 172.21.15.164:0/1299031563 reap_dead start 2020-11-20T11:50:51.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f213d7bf700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2120003d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f213400c440 tx=0x7f21381513b0).ready entity=mon.1 client_cookie=1dd13d7430eec16a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:51.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213400ce20 con 0x7f2120003950 2020-11-20T11:50:51.118 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21340072e0 con 0x7f2120003950 2020-11-20T11:50:51.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.105+0000 7f2127fff700 1 -- 172.21.15.164:0/1299031563 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134005630 con 0x7f2120003950 2020-11-20T11:50:51.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.106+0000 7f213fa23700 1 -- 172.21.15.164:0/1299031563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 msgr2=0x7f2120003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.106+0000 7f213fa23700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2120003d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f213400c440 tx=0x7f21381513b0).stop 2020-11-20T11:50:51.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.106+0000 7f213fa23700 1 -- 172.21.15.164:0/1299031563 shutdown_connections 2020-11-20T11:50:51.119 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.106+0000 7f213fa23700 1 --2- 172.21.15.164:0/1299031563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2120003d50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.106+0000 7f213fa23700 1 -- 172.21.15.164:0/1299031563 >> 172.21.15.164:0/1299031563 conn(0x7f21380619e0 msgr2=0x7f2138061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:51.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.106+0000 7f213fa23700 1 -- 172.21.15.164:0/1299031563 shutdown_connections 2020-11-20T11:50:51.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.106+0000 7f213fa23700 1 -- 172.21.15.164:0/1299031563 wait complete. 2020-11-20T11:50:51.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.107+0000 7f213fa23700 1 Processor -- start 2020-11-20T11:50:51.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.107+0000 7f213fa23700 1 -- start start 2020-11-20T11:50:51.123 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213fa23700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2138152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.123 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213fa23700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2138160910 0x7f21381647e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.123 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213fa23700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2138153f90 0x7f21381543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.123 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213fa23700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21381548e0 con 0x7f2138153f90 2020-11-20T11:50:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213fa23700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2138163e70 con 0x7f2120003950 2020-11-20T11:50:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213fa23700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2138158110 con 0x7f2138160910 2020-11-20T11:50:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213d7bf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2138152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213d7bf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2138152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45912/0 (socket says 172.21.15.164:45912) 2020-11-20T11:50:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213d7bf700 1 -- 172.21.15.164:0/580427565 learned_addr learned my addr 172.21.15.164:0/580427565 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:51.125 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213cfbe700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2138160910 0x7f21381647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.125 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213dfc0700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2138153f90 0x7f21381543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.125 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213d7bf700 1 -- 172.21.15.164:0/580427565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2138160910 msgr2=0x7f21381647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.125 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213d7bf700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2138160910 0x7f21381647e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.126 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213d7bf700 1 -- 172.21.15.164:0/580427565 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2138153f90 msgr2=0x7f21381543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.126 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213d7bf700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2138153f90 0x7f21381543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.126 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213d7bf700 1 -- 172.21.15.164:0/580427565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21381583b0 con 0x7f2120003950 2020-11-20T11:50:51.126 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213cfbe700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2138160910 0x7f21381647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:51.126 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213dfc0700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2138153f90 0x7f21381543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:51.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.108+0000 7f213d7bf700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2138152860 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f2134005f40 tx=0x7f2134013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:51.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.109+0000 7f21257fa700 1 -- 172.21.15.164:0/580427565 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213401b070 con 0x7f2120003950 2020-11-20T11:50:51.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.109+0000 7f21257fa700 1 -- 172.21.15.164:0/580427565 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2134001420 con 0x7f2120003950 2020-11-20T11:50:51.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.109+0000 7f213fa23700 1 -- 172.21.15.164:0/580427565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2138158650 con 0x7f2120003950 2020-11-20T11:50:51.127 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.109+0000 7f21257fa700 1 -- 172.21.15.164:0/580427565 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134013660 con 0x7f2120003950 2020-11-20T11:50:51.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.109+0000 7f213fa23700 1 -- 172.21.15.164:0/580427565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21381640a0 con 0x7f2120003950 2020-11-20T11:50:51.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.110+0000 7f213fa23700 1 -- 172.21.15.164:0/580427565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2138069b70 con 0x7f2120003950 2020-11-20T11:50:51.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.110+0000 7f21257fa700 1 -- 172.21.15.164:0/580427565 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2134027070 con 0x7f2120003950 2020-11-20T11:50:51.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.111+0000 7f21257fa700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2110080670 0x7f2110082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.128 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.111+0000 7f213cfbe700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2110080670 0x7f2110082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.111+0000 7f21257fa700 1 -- 172.21.15.164:0/580427565 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f21340a3430 con 0x7f2120003950 2020-11-20T11:50:51.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.111+0000 7f213cfbe700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2110080670 0x7f2110082b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2128006ad0 tx=0x7f2128008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:51.129 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.114+0000 7f21257fa700 1 -- 172.21.15.164:0/580427565 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2134077e40 con 0x7f2120003950 2020-11-20T11:50:51.310 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.306+0000 7f213fa23700 1 -- 172.21.15.164:0/580427565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f21380be920 con 0x7f2120003950 2020-11-20T11:50:51.310 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.306+0000 7f21257fa700 1 -- 172.21.15.164:0/580427565 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f213407b460 con 0x7f2120003950 2020-11-20T11:50:51.311 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:51.312 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 -- 172.21.15.164:0/580427565 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2110080670 msgr2=0x7f2110082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.312 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2110080670 0x7f2110082b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2128006ad0 tx=0x7f2128008040).stop 2020-11-20T11:50:51.312 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 -- 172.21.15.164:0/580427565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 msgr2=0x7f2138152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.312 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2138152860 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f2134005f40 tx=0x7f2134013000).stop 2020-11-20T11:50:51.313 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 -- 172.21.15.164:0/580427565 shutdown_connections 2020-11-20T11:50:51.313 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2110080670 0x7f2110082b30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.313 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2120003950 0x7f2138152860 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.313 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2138153f90 0x7f21381543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 --2- 172.21.15.164:0/580427565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2138160910 0x7f21381647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 -- 172.21.15.164:0/580427565 >> 172.21.15.164:0/580427565 conn(0x7f21380619e0 msgr2=0x7f21380bfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:51.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 -- 172.21.15.164:0/580427565 shutdown_connections 2020-11-20T11:50:51.314 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.308+0000 7f213fa23700 1 -- 172.21.15.164:0/580427565 wait complete. 2020-11-20T11:50:51.323 INFO:teuthology.orchestra.run.smithi164.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-20T11:50:51.323 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-11-20T11:50:51.324 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:51.459 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.456+0000 7f4ca5727700 1 Processor -- start 2020-11-20T11:50:51.460 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.456+0000 7f4ca5727700 1 -- start start 2020-11-20T11:50:51.462 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.456+0000 7f4ca5727700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4ca0151060 0x7f4ca00bb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.462 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.456+0000 7f4ca5727700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4ca00bbb40 0x7f4ca014a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.462 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.456+0000 7f4ca5727700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca0067680 con 0x7f4ca0150c80 2020-11-20T11:50:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.456+0000 7f4ca5727700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca0067920 con 0x7f4ca00bbb40 2020-11-20T11:50:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.456+0000 7f4ca5727700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca0067bc0 con 0x7f4ca0151060 2020-11-20T11:50:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9e7fc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4ca0151060 0x7f4ca00bb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9e7fc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4ca0151060 0x7f4ca00bb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45924/0 (socket says 172.21.15.164:45924) 2020-11-20T11:50:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9e7fc700 1 -- 172.21.15.164:0/2299268659 learned_addr learned my addr 172.21.15.164:0/2299268659 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9f7fe700 1 --2- 172.21.15.164:0/2299268659 >> v2:172.21.15.36:3300/0 conn(0x7f4ca00bbb40 0x7f4ca014a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9e7fc700 1 -- 172.21.15.164:0/2299268659 >> v2:172.21.15.36:3300/0 conn(0x7f4ca00bbb40 msgr2=0x7f4ca014a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9e7fc700 1 --2- 172.21.15.164:0/2299268659 >> v2:172.21.15.36:3300/0 conn(0x7f4ca00bbb40 0x7f4ca014a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9e7fc700 1 -- 172.21.15.164:0/2299268659 >> v1:172.21.15.36:6789/0 conn(0x7f4ca0150c80 legacy=0x7f4ca00bcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9e7fc700 1 -- 172.21.15.164:0/2299268659 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca0067e60 con 0x7f4ca0151060 2020-11-20T11:50:51.465 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9e7fc700 1 --2- 172.21.15.164:0/2299268659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 0x7f4ca00bb650 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4ca00656a0 tx=0x7f4c94006ef0).ready entity=mon.1 client_cookie=be3c3acfcf844073 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:51.465 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9dffb700 1 -- 172.21.15.164:0/2299268659 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9400b860 con 0x7f4ca0151060 2020-11-20T11:50:51.465 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9dffb700 1 -- 172.21.15.164:0/2299268659 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c94000e90 con 0x7f4ca0151060 2020-11-20T11:50:51.465 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.457+0000 7f4c9dffb700 1 -- 172.21.15.164:0/2299268659 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9400bbd0 con 0x7f4ca0151060 2020-11-20T11:50:51.465 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.458+0000 7f4ca5727700 1 -- 172.21.15.164:0/2299268659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 msgr2=0x7f4ca00bb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.466 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.458+0000 7f4ca5727700 1 --2- 172.21.15.164:0/2299268659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 0x7f4ca00bb650 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4ca00656a0 tx=0x7f4c94006ef0).stop 2020-11-20T11:50:51.466 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.458+0000 7f4ca5727700 1 -- 172.21.15.164:0/2299268659 shutdown_connections 2020-11-20T11:50:51.466 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.458+0000 7f4ca5727700 1 --2- 172.21.15.164:0/2299268659 >> v2:172.21.15.36:3300/0 conn(0x7f4ca00bbb40 0x7f4ca014a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.466 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.458+0000 7f4ca5727700 1 --2- 172.21.15.164:0/2299268659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 0x7f4ca00bb650 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.466 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.458+0000 7f4ca5727700 1 -- 172.21.15.164:0/2299268659 >> 172.21.15.164:0/2299268659 conn(0x7f4ca00601b0 msgr2=0x7f4ca00605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:51.467 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.458+0000 7f4ca5727700 1 -- 172.21.15.164:0/2299268659 shutdown_connections 2020-11-20T11:50:51.467 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.458+0000 7f4ca5727700 1 -- 172.21.15.164:0/2299268659 wait complete. 2020-11-20T11:50:51.469 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.459+0000 7f4ca5727700 1 Processor -- start 2020-11-20T11:50:51.470 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.459+0000 7f4ca5727700 1 -- start start 2020-11-20T11:50:51.470 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4ca5727700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ca00bbb40 0x7f4ca014aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.470 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4ca5727700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ca0150c80 0x7f4ca01624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.470 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4ca5727700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 0x7f4ca015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.471 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4ca5727700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca013a6f0 con 0x7f4ca00bbb40 2020-11-20T11:50:51.471 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4ca5727700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca01629d0 con 0x7f4ca0151060 2020-11-20T11:50:51.471 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4ca5727700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca013a8e0 con 0x7f4ca0150c80 2020-11-20T11:50:51.471 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9f7fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 0x7f4ca015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.471 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9f7fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 0x7f4ca015ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45930/0 (socket says 172.21.15.164:45930) 2020-11-20T11:50:51.472 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9f7fe700 1 -- 172.21.15.164:0/827696778 learned_addr learned my addr 172.21.15.164:0/827696778 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:51.472 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9effd700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ca00bbb40 0x7f4ca014aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.472 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9e7fc700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ca0150c80 0x7f4ca01624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.472 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9f7fe700 1 -- 172.21.15.164:0/827696778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ca0150c80 msgr2=0x7f4ca01624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.472 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9f7fe700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ca0150c80 0x7f4ca01624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.473 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9f7fe700 1 -- 172.21.15.164:0/827696778 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ca00bbb40 msgr2=0x7f4ca014aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.473 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9f7fe700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ca00bbb40 0x7f4ca014aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.473 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9f7fe700 1 -- 172.21.15.164:0/827696778 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca013ab80 con 0x7f4ca0151060 2020-11-20T11:50:51.473 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9e7fc700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ca0150c80 0x7f4ca01624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:51.473 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c9f7fe700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 0x7f4ca015ee30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4c9800db60 tx=0x7f4c98008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:51.474 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c86ffd700 1 -- 172.21.15.164:0/827696778 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98017070 con 0x7f4ca0151060 2020-11-20T11:50:51.474 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c86ffd700 1 -- 172.21.15.164:0/827696778 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9800b8b0 con 0x7f4ca0151060 2020-11-20T11:50:51.474 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4ca5727700 1 -- 172.21.15.164:0/827696778 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca013ae20 con 0x7f4ca0151060 2020-11-20T11:50:51.474 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4c86ffd700 1 -- 172.21.15.164:0/827696778 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800bc50 con 0x7f4ca0151060 2020-11-20T11:50:51.474 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.460+0000 7f4ca5727700 1 -- 172.21.15.164:0/827696778 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca015e990 con 0x7f4ca0151060 2020-11-20T11:50:51.475 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.461+0000 7f4ca5727700 1 -- 172.21.15.164:0/827696778 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca015eb50 con 0x7f4ca0151060 2020-11-20T11:50:51.475 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.462+0000 7f4c86ffd700 1 -- 172.21.15.164:0/827696778 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4c98013480 con 0x7f4ca0151060 2020-11-20T11:50:51.475 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.462+0000 7f4c86ffd700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4c7c080670 0x7f4c7c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.475 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.463+0000 7f4c86ffd700 1 -- 172.21.15.164:0/827696778 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f4c980a2bc0 con 0x7f4ca0151060 2020-11-20T11:50:51.475 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.463+0000 7f4c9effd700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4c7c080670 0x7f4c7c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.476 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.463+0000 7f4c9effd700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4c7c080670 0x7f4c7c082b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4c90000c00 tx=0x7f4c90007bb0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:51.476 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.466+0000 7f4c86ffd700 1 -- 172.21.15.164:0/827696778 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4c98077570 con 0x7f4ca0151060 2020-11-20T11:50:51.609 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.605+0000 7f4ca5727700 1 -- 172.21.15.164:0/827696778 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca0069b70 con 0x7f4ca0151060 2020-11-20T11:50:51.610 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.606+0000 7f4c86ffd700 1 -- 172.21.15.164:0/827696778 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f4c9807ab90 con 0x7f4ca0151060 2020-11-20T11:50:51.611 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:51.611 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:39.612589+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:50:34.615204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:50:37.302647+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:51.612 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 -- 172.21.15.164:0/827696778 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4c7c080670 msgr2=0x7f4c7c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.612 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4c7c080670 0x7f4c7c082b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4c90000c00 tx=0x7f4c90007bb0).stop 2020-11-20T11:50:51.612 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 -- 172.21.15.164:0/827696778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 msgr2=0x7f4ca015ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.613 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 0x7f4ca015ee30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4c9800db60 tx=0x7f4c98008040).stop 2020-11-20T11:50:51.613 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 -- 172.21.15.164:0/827696778 shutdown_connections 2020-11-20T11:50:51.613 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4c7c080670 0x7f4c7c082b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.613 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca0151060 0x7f4ca015ee30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.614 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ca00bbb40 0x7f4ca014aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.614 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 --2- 172.21.15.164:0/827696778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ca0150c80 0x7f4ca01624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.614 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 -- 172.21.15.164:0/827696778 >> 172.21.15.164:0/827696778 conn(0x7f4ca00601b0 msgr2=0x7f4ca014eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:51.614 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 -- 172.21.15.164:0/827696778 shutdown_connections 2020-11-20T11:50:51.614 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.608+0000 7f4ca5727700 1 -- 172.21.15.164:0/827696778 wait complete. 2020-11-20T11:50:51.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:50:22.130897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:50:32.016548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:50:34.615204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:50:37.302647+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:50:51.624 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:50:51.737 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.734+0000 7f474ffff700 1 Processor -- start 2020-11-20T11:50:51.738 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.734+0000 7f474ffff700 1 -- start start 2020-11-20T11:50:51.741 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f47500bca80 0x7f47500c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.741 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474ffff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47501553a0 con 0x7f47500c77b0 2020-11-20T11:50:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474ffff700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500c06a0 con 0x7f4750150f80 2020-11-20T11:50:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474ffff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4750151410 con 0x7f47500bca80 2020-11-20T11:50:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474f7fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f4750150f80 0x7f47500bf870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55678/0 (socket says 172.21.15.164:55678) 2020-11-20T11:50:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474f7fe700 1 -- 172.21.15.164:0/3037812429 learned_addr learned my addr 172.21.15.164:0/3037812429 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474e7fc700 1 --2- 172.21.15.164:0/3037812429 >> v2:172.21.15.36:3300/0 conn(0x7f47500bca80 0x7f47500c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251076383 0 0) 0x7f47500c06a0 con 0x7f4750150f80 2020-11-20T11:50:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f473c003280 con 0x7f4750150f80 2020-11-20T11:50:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 716601255 0 0) 0x7f473c003280 con 0x7f4750150f80 2020-11-20T11:50:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 >> v2:172.21.15.36:3300/0 conn(0x7f47500bca80 msgr2=0x7f47500c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:51.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 --2- 172.21.15.164:0/3037812429 >> v2:172.21.15.36:3300/0 conn(0x7f47500bca80 0x7f47500c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 >> v1:172.21.15.36:6789/0 conn(0x7f47500c77b0 legacy=0x7f47500c0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750151600 con 0x7f4750150f80 2020-11-20T11:50:51.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7f47480018a0 con 0x7f4750150f80 2020-11-20T11:50:51.745 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 >> v1:172.21.15.164:6789/0 conn(0x7f4750150f80 legacy=0x7f47500bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.745 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f473c0037c0 0x7f473c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.745 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c004520 0x7f473c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.745 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.735+0000 7f474dffb700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f473c004e90 0x7f473c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.746 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c005340 con 0x7f473c0037c0 2020-11-20T11:50:51.746 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c00bc60 con 0x7f473c004520 2020-11-20T11:50:51.747 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c00bda0 con 0x7f473c004e90 2020-11-20T11:50:51.747 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474e7fc700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c004520 0x7f473c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.747 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474effd700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f473c0037c0 0x7f473c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.747 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474f7fe700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f473c004e90 0x7f473c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.748 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474e7fc700 1 -- 172.21.15.164:0/3037812429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f473c004e90 msgr2=0x7f473c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:51.748 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474e7fc700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f473c004e90 0x7f473c00b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.748 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474e7fc700 1 -- 172.21.15.164:0/3037812429 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f473c0037c0 msgr2=0x7f473c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:51.748 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474e7fc700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f473c0037c0 0x7f473c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474f7fe700 1 -- 172.21.15.164:0/3037812429 reap_dead start 2020-11-20T11:50:51.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474e7fc700 1 -- 172.21.15.164:0/3037812429 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c003280 con 0x7f473c004520 2020-11-20T11:50:51.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474e7fc700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c004520 0x7f473c0049a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f4744006fd0 tx=0x7f4744008040).ready entity=mon.1 client_cookie=a4ae87b9e9e9de3b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:51.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474400b300 con 0x7f473c004520 2020-11-20T11:50:51.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474400e970 con 0x7f473c004520 2020-11-20T11:50:51.750 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.736+0000 7f474dffb700 1 -- 172.21.15.164:0/3037812429 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474400ecf0 con 0x7f473c004520 2020-11-20T11:50:51.750 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.737+0000 7f474ffff700 1 -- 172.21.15.164:0/3037812429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c004520 msgr2=0x7f473c0049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.750 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.737+0000 7f474ffff700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c004520 0x7f473c0049a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f4744006fd0 tx=0x7f4744008040).stop 2020-11-20T11:50:51.750 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.737+0000 7f474ffff700 1 -- 172.21.15.164:0/3037812429 shutdown_connections 2020-11-20T11:50:51.750 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.737+0000 7f474ffff700 1 --2- 172.21.15.164:0/3037812429 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c004520 0x7f473c0049a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.751 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.737+0000 7f474ffff700 1 -- 172.21.15.164:0/3037812429 >> 172.21.15.164:0/3037812429 conn(0x7f475007ffb0 msgr2=0x7f47500803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:51.752 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.737+0000 7f474ffff700 1 -- 172.21.15.164:0/3037812429 shutdown_connections 2020-11-20T11:50:51.753 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.737+0000 7f474ffff700 1 -- 172.21.15.164:0/3037812429 wait complete. 2020-11-20T11:50:51.753 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.738+0000 7f474ffff700 1 Processor -- start 2020-11-20T11:50:51.753 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.738+0000 7f474ffff700 1 -- start start 2020-11-20T11:50:51.756 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f473c004520 0x7f4750155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.756 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4750160240 0x7f4750150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.756 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474ffff700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4750148fc0 0x7f475014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474ffff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750160750 con 0x7f473c004520 2020-11-20T11:50:51.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474ffff700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47501609f0 con 0x7f4750160240 2020-11-20T11:50:51.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474ffff700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750160c90 con 0x7f4750148fc0 2020-11-20T11:50:51.757 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474e7fc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4750160240 0x7f4750150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474e7fc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4750160240 0x7f4750150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45946/0 (socket says 172.21.15.164:45946) 2020-11-20T11:50:51.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474e7fc700 1 -- 172.21.15.164:0/3969713012 learned_addr learned my addr 172.21.15.164:0/3969713012 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:51.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474effd700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f473c004520 0x7f4750155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.758 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474f7fe700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4750148fc0 0x7f475014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.759 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474e7fc700 1 -- 172.21.15.164:0/3969713012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4750148fc0 msgr2=0x7f475014eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.759 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474e7fc700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4750148fc0 0x7f475014eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.759 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474e7fc700 1 -- 172.21.15.164:0/3969713012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f473c004520 msgr2=0x7f4750155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.759 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474e7fc700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f473c004520 0x7f4750155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.759 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474e7fc700 1 -- 172.21.15.164:0/3969713012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750160f30 con 0x7f4750160240 2020-11-20T11:50:51.760 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474effd700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f473c004520 0x7f4750155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:51.760 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474e7fc700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4750160240 0x7f4750150630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f47500be380 tx=0x7f4744019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:51.760 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f4736ffd700 1 -- 172.21.15.164:0/3969713012 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744012ea0 con 0x7f4750160240 2020-11-20T11:50:51.760 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f4736ffd700 1 -- 172.21.15.164:0/3969713012 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4744000e90 con 0x7f4750160240 2020-11-20T11:50:51.761 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474ffff700 1 -- 172.21.15.164:0/3969713012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4750152490 con 0x7f4750160240 2020-11-20T11:50:51.761 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f4736ffd700 1 -- 172.21.15.164:0/3969713012 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474401b450 con 0x7f4750160240 2020-11-20T11:50:51.761 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.739+0000 7f474ffff700 1 -- 172.21.15.164:0/3969713012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4750149440 con 0x7f4750160240 2020-11-20T11:50:51.761 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.740+0000 7f474ffff700 1 -- 172.21.15.164:0/3969713012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4750044fa0 con 0x7f4750160240 2020-11-20T11:50:51.761 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.741+0000 7f4736ffd700 1 -- 172.21.15.164:0/3969713012 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f474401b7c0 con 0x7f4750160240 2020-11-20T11:50:51.762 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.741+0000 7f4736ffd700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f472c0806a0 0x7f472c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:51.762 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.741+0000 7f4736ffd700 1 -- 172.21.15.164:0/3969713012 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f47440a49a0 con 0x7f4750160240 2020-11-20T11:50:51.763 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.741+0000 7f474effd700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f472c0806a0 0x7f472c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:51.763 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.742+0000 7f474effd700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f472c0806a0 0x7f472c082b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4740000c00 tx=0x7f4740009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:51.763 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.745+0000 7f4736ffd700 1 -- 172.21.15.164:0/3969713012 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4744079330 con 0x7f4750160240 2020-11-20T11:50:51.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.884+0000 7f474ffff700 1 -- 172.21.15.164:0/3969713012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4750150b40 con 0x7f4750160240 2020-11-20T11:50:51.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.884+0000 7f4736ffd700 1 -- 172.21.15.164:0/3969713012 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7f474407c950 con 0x7f4750160240 2020-11-20T11:50:51.888 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2020-11-20T11:50:51.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 -- 172.21.15.164:0/3969713012 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f472c0806a0 msgr2=0x7f472c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f472c0806a0 0x7f472c082b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4740000c00 tx=0x7f4740009040).stop 2020-11-20T11:50:51.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 -- 172.21.15.164:0/3969713012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4750160240 msgr2=0x7f4750150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:51.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4750160240 0x7f4750150630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f47500be380 tx=0x7f4744019000).stop 2020-11-20T11:50:51.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 -- 172.21.15.164:0/3969713012 shutdown_connections 2020-11-20T11:50:51.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f472c0806a0 0x7f472c082b60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4750148fc0 0x7f475014eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f473c004520 0x7f4750155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 --2- 172.21.15.164:0/3969713012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4750160240 0x7f4750150630 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:51.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 -- 172.21.15.164:0/3969713012 >> 172.21.15.164:0/3969713012 conn(0x7f475007ffb0 msgr2=0x7f47500c0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:51.892 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 -- 172.21.15.164:0/3969713012 shutdown_connections 2020-11-20T11:50:51.892 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:51.886+0000 7f474ffff700 1 -- 172.21.15.164:0/3969713012 wait complete. 2020-11-20T11:50:51.901 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:50:52.021 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.008+0000 7ff7a0ec9700 1 Processor -- start 2020-11-20T11:50:52.022 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.008+0000 7ff7a0ec9700 1 -- start start 2020-11-20T11:50:52.022 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.009+0000 7ff7a0ec9700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff79c0c4200 0x7ff79c0bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.022 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.009+0000 7ff7a0ec9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79c151780 con 0x7ff79c0c0ba0 2020-11-20T11:50:52.023 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.009+0000 7ff7a0ec9700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79c151a20 con 0x7ff79c0c45e0 2020-11-20T11:50:52.023 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.009+0000 7ff7a0ec9700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79c0c4a60 con 0x7ff79c0c4200 2020-11-20T11:50:52.023 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.009+0000 7ff79ad9d700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff79c0c0ba0 0x7ff79c0bf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55696/0 (socket says 172.21.15.164:55696) 2020-11-20T11:50:52.024 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.009+0000 7ff79ad9d700 1 -- 172.21.15.164:0/2662032470 learned_addr learned my addr 172.21.15.164:0/2662032470 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:52.025 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.009+0000 7ff79a59c700 1 --2- 172.21.15.164:0/2662032470 >> v2:172.21.15.36:3300/0 conn(0x7ff79c0c4200 0x7ff79c0bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.025 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.009+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136430115 0 0) 0x7ff79c151780 con 0x7ff79c0c0ba0 2020-11-20T11:50:52.027 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff77c003280 con 0x7ff79c0c0ba0 2020-11-20T11:50:52.029 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592311284 0 0) 0x7ff79c151a20 con 0x7ff79c0c45e0 2020-11-20T11:50:52.029 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff79c151780 con 0x7ff79c0c45e0 2020-11-20T11:50:52.030 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1195464910 0 0) 0x7ff77c003280 con 0x7ff79c0c0ba0 2020-11-20T11:50:52.030 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 >> v2:172.21.15.36:3300/0 conn(0x7ff79c0c4200 msgr2=0x7ff79c0bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:52.031 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 --2- 172.21.15.164:0/2662032470 >> v2:172.21.15.36:3300/0 conn(0x7ff79c0c4200 0x7ff79c0bccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.031 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 >> v1:172.21.15.188:6789/0 conn(0x7ff79c0c45e0 legacy=0x7ff79c150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.032 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c151cc0 con 0x7ff79c0c0ba0 2020-11-20T11:50:52.032 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7ff7940018a0 con 0x7ff79c0c0ba0 2020-11-20T11:50:52.033 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 >> v1:172.21.15.164:6789/0 conn(0x7ff79c0c0ba0 legacy=0x7ff79c0bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.033 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff77c003950 0x7ff77c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.034 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff77c004520 0x7ff77c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.034 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff77c004e90 0x7ff77c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.034 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0c4a60 con 0x7ff77c004e90 2020-11-20T11:50:52.035 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c00bc60 con 0x7ff77c003950 2020-11-20T11:50:52.035 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c00bda0 con 0x7ff77c004520 2020-11-20T11:50:52.036 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff79a59c700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff77c003950 0x7ff77c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.036 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff793fff700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff77c004520 0x7ff77c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.037 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff79ad9d700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff77c004e90 0x7ff77c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.038 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff79a59c700 1 -- 172.21.15.164:0/2662032470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff77c004520 msgr2=0x7ff77c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:52.038 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff79a59c700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff77c004520 0x7ff77c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.039 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff79a59c700 1 -- 172.21.15.164:0/2662032470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff77c004e90 msgr2=0x7ff77c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:52.039 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff79a59c700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff77c004e90 0x7ff77c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.039 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff79ad9d700 1 -- 172.21.15.164:0/2662032470 reap_dead start 2020-11-20T11:50:52.040 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff79a59c700 1 -- 172.21.15.164:0/2662032470 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c003280 con 0x7ff77c003950 2020-11-20T11:50:52.040 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff79a59c700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff77c003950 0x7ff77c003d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff78c00bc40 tx=0x7ff78c006e30).ready entity=mon.1 client_cookie=5f2622a204c092ac server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.040 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.010+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00b350 con 0x7ff77c003950 2020-11-20T11:50:52.041 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.011+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c00e9a0 con 0x7ff77c003950 2020-11-20T11:50:52.041 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.011+0000 7ff799d9b700 1 -- 172.21.15.164:0/2662032470 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00ed20 con 0x7ff77c003950 2020-11-20T11:50:52.041 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.011+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/2662032470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff77c003950 msgr2=0x7ff77c003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.041 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.011+0000 7ff7a0ec9700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff77c003950 0x7ff77c003d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff78c00bc40 tx=0x7ff78c006e30).stop 2020-11-20T11:50:52.042 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.011+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/2662032470 shutdown_connections 2020-11-20T11:50:52.042 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.011+0000 7ff7a0ec9700 1 --2- 172.21.15.164:0/2662032470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff77c003950 0x7ff77c003d50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.042 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.011+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/2662032470 >> 172.21.15.164:0/2662032470 conn(0x7ff79c0678e0 msgr2=0x7ff79c067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:52.042 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.011+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/2662032470 shutdown_connections 2020-11-20T11:50:52.042 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.011+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/2662032470 wait complete. 2020-11-20T11:50:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.012+0000 7ff7a0ec9700 1 Processor -- start 2020-11-20T11:50:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.012+0000 7ff7a0ec9700 1 -- start start 2020-11-20T11:50:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff7a0ec9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff77c003950 0x7ff79c0c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff7a0ec9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff79c152d10 0x7ff79c14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.044 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff7a0ec9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0c2330 0x7ff79c0c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.044 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff7a0ec9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c150d50 con 0x7ff77c003950 2020-11-20T11:50:52.044 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff7a0ec9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0c5f10 con 0x7ff79c0c2330 2020-11-20T11:50:52.044 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff7a0ec9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0c61b0 con 0x7ff79c152d10 2020-11-20T11:50:52.044 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff79ad9d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0c2330 0x7ff79c0c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff79ad9d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0c2330 0x7ff79c0c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45970/0 (socket says 172.21.15.164:45970) 2020-11-20T11:50:52.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff79ad9d700 1 -- 172.21.15.164:0/1978206441 learned_addr learned my addr 172.21.15.164:0/1978206441 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:52.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff79a59c700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff77c003950 0x7ff79c0c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff793fff700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff79c152d10 0x7ff79c14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff79ad9d700 1 -- 172.21.15.164:0/1978206441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff79c152d10 msgr2=0x7ff79c14f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.046 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff79ad9d700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff79c152d10 0x7ff79c14f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.046 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff79ad9d700 1 -- 172.21.15.164:0/1978206441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff77c003950 msgr2=0x7ff79c0c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.046 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff79ad9d700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff77c003950 0x7ff79c0c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.046 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff79ad9d700 1 -- 172.21.15.164:0/1978206441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c0c6450 con 0x7ff79c0c2330 2020-11-20T11:50:52.047 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff793fff700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff79c152d10 0x7ff79c14f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:50:52.047 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff79ad9d700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0c2330 0x7ff79c0c2790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ff79c0629b0 tx=0x7ff79c0c00d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.047 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.013+0000 7ff7927fc700 1 -- 172.21.15.164:0/1978206441 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400fc30 con 0x7ff79c0c2330 2020-11-20T11:50:52.047 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.014+0000 7ff7927fc700 1 -- 172.21.15.164:0/1978206441 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79400fd90 con 0x7ff79c0c2330 2020-11-20T11:50:52.047 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.014+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/1978206441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79c14f3c0 con 0x7ff79c0c2330 2020-11-20T11:50:52.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.014+0000 7ff7927fc700 1 -- 172.21.15.164:0/1978206441 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794012580 con 0x7ff79c0c2330 2020-11-20T11:50:52.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.014+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/1978206441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c1639d0 con 0x7ff79c0c2330 2020-11-20T11:50:52.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.015+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/1978206441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79c069b70 con 0x7ff79c0c2330 2020-11-20T11:50:52.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.015+0000 7ff7927fc700 1 -- 172.21.15.164:0/1978206441 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff79401b030 con 0x7ff79c0c2330 2020-11-20T11:50:52.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.016+0000 7ff7927fc700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff778080670 0x7ff778082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.016+0000 7ff79a59c700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff778080670 0x7ff778082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.016+0000 7ff7927fc700 1 -- 172.21.15.164:0/1978206441 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff7940a2460 con 0x7ff79c0c2330 2020-11-20T11:50:52.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.016+0000 7ff79a59c700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff778080670 0x7ff778082b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7ff78c006e70 tx=0x7ff78c019000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.019+0000 7ff7927fc700 1 -- 172.21.15.164:0/1978206441 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff794076e70 con 0x7ff79c0c2330 2020-11-20T11:50:52.170 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.163+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/1978206441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff79c14f550 con 0x7ff79c0c2330 2020-11-20T11:50:52.170 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.163+0000 7ff7927fc700 1 -- 172.21.15.164:0/1978206441 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff794019020 con 0x7ff79c0c2330 2020-11-20T11:50:52.171 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/1978206441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff778080670 msgr2=0x7ff778082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.171 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff778080670 0x7ff778082b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7ff78c006e70 tx=0x7ff78c019000).stop 2020-11-20T11:50:52.171 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/1978206441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0c2330 msgr2=0x7ff79c0c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.172 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0c2330 0x7ff79c0c2790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ff79c0629b0 tx=0x7ff79c0c00d0).stop 2020-11-20T11:50:52.172 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/1978206441 shutdown_connections 2020-11-20T11:50:52.172 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff778080670 0x7ff778082b30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.173 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff79c0c2330 0x7ff79c0c2790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.173 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff77c003950 0x7ff79c0c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.173 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 --2- 172.21.15.164:0/1978206441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff79c152d10 0x7ff79c14f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.174 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/1978206441 >> 172.21.15.164:0/1978206441 conn(0x7ff79c0678e0 msgr2=0x7ff79c0c4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:52.174 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/1978206441 shutdown_connections 2020-11-20T11:50:52.174 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.165+0000 7ff7a0ec9700 1 -- 172.21.15.164:0/1978206441 wait complete. 2020-11-20T11:50:52.175 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 8 2020-11-20T11:50:52.181 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:50:52.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.298+0000 7f43ec48a700 1 Processor -- start 2020-11-20T11:50:52.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.298+0000 7f43ec48a700 1 -- start start 2020-11-20T11:50:52.329 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43ec48a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f43e4150d00 0x7f43e4062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.331 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43ec48a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e4062a60 con 0x7f43e40650f0 2020-11-20T11:50:52.331 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43ec48a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e4062520 con 0x7f43e4064d10 2020-11-20T11:50:52.332 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43ec48a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e40627c0 con 0x7f43e4150d00 2020-11-20T11:50:52.333 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43eaa27700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f43e4150d00 0x7f43e4062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.333 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43ea226700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f43e4064d10 0x7f43e40baf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55714/0 (socket says 172.21.15.164:55714) 2020-11-20T11:50:52.333 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43eaa27700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f43e4150d00 0x7f43e4062ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45978/0 (socket says 172.21.15.164:45978) 2020-11-20T11:50:52.334 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43ea226700 1 -- 172.21.15.164:0/1023257727 learned_addr learned my addr 172.21.15.164:0/1023257727 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:52.334 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43eaa27700 1 -- 172.21.15.164:0/1023257727 >> v1:172.21.15.164:6789/0 conn(0x7f43e4064d10 legacy=0x7f43e40baf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.334 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43eaa27700 1 -- 172.21.15.164:0/1023257727 >> v1:172.21.15.36:6789/0 conn(0x7f43e40650f0 legacy=0x7f43e41505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.335 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43eaa27700 1 -- 172.21.15.164:0/1023257727 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e4151260 con 0x7f43e4150d00 2020-11-20T11:50:52.335 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43e9224700 1 -- 172.21.15.164:0/1023257727 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32278065 0 0) 0x7f43e4062520 con 0x7f43e4064d10 2020-11-20T11:50:52.336 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43eaa27700 1 --2- 172.21.15.164:0/1023257727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e4150d00 0x7f43e4062ef0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f43dc009ce0 tx=0x7f43dc009220).ready entity=mon.1 client_cookie=afd709b95e257dae server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.336 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43e9224700 1 -- 172.21.15.164:0/1023257727 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00bc80 con 0x7f43e4150d00 2020-11-20T11:50:52.336 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43e9224700 1 -- 172.21.15.164:0/1023257727 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc00bde0 con 0x7f43e4150d00 2020-11-20T11:50:52.337 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.299+0000 7f43e9224700 1 -- 172.21.15.164:0/1023257727 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc011610 con 0x7f43e4150d00 2020-11-20T11:50:52.337 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.300+0000 7f43ec48a700 1 -- 172.21.15.164:0/1023257727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e4150d00 msgr2=0x7f43e4062ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.338 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.300+0000 7f43ec48a700 1 --2- 172.21.15.164:0/1023257727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e4150d00 0x7f43e4062ef0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f43dc009ce0 tx=0x7f43dc009220).stop 2020-11-20T11:50:52.338 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.300+0000 7f43ec48a700 1 -- 172.21.15.164:0/1023257727 shutdown_connections 2020-11-20T11:50:52.338 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.300+0000 7f43ec48a700 1 --2- 172.21.15.164:0/1023257727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e4150d00 0x7f43e4062ef0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.339 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.300+0000 7f43ec48a700 1 -- 172.21.15.164:0/1023257727 >> 172.21.15.164:0/1023257727 conn(0x7f43e40c55c0 msgr2=0x7f43e40c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:52.339 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.300+0000 7f43ec48a700 1 -- 172.21.15.164:0/1023257727 shutdown_connections 2020-11-20T11:50:52.340 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.300+0000 7f43ec48a700 1 -- 172.21.15.164:0/1023257727 wait complete. 2020-11-20T11:50:52.340 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.301+0000 7f43ec48a700 1 Processor -- start 2020-11-20T11:50:52.340 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.301+0000 7f43ec48a700 1 -- start start 2020-11-20T11:50:52.341 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43ec48a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43e4064d10 0x7f43e4155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.342 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43ec48a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e40650f0 0x7f43e40c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.342 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43ec48a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43e4150d00 0x7f43e40c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.343 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43ec48a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40c33f0 con 0x7f43e4150d00 2020-11-20T11:50:52.343 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43ec48a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4153a50 con 0x7f43e40650f0 2020-11-20T11:50:52.344 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43ec48a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4153cb0 con 0x7f43e4064d10 2020-11-20T11:50:52.344 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43e9a25700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e40650f0 0x7f43e40c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.344 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43e9a25700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e40650f0 0x7f43e40c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45982/0 (socket says 172.21.15.164:45982) 2020-11-20T11:50:52.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43e9a25700 1 -- 172.21.15.164:0/3598158602 learned_addr learned my addr 172.21.15.164:0/3598158602 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:52.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43ea226700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43e4064d10 0x7f43e4155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43eaa27700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43e4150d00 0x7f43e40c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43e9a25700 1 -- 172.21.15.164:0/3598158602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43e4064d10 msgr2=0x7f43e4155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43e9a25700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43e4064d10 0x7f43e4155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43e9a25700 1 -- 172.21.15.164:0/3598158602 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43e4150d00 msgr2=0x7f43e40c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43e9a25700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43e4150d00 0x7f43e40c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43e9a25700 1 -- 172.21.15.164:0/3598158602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e4153f50 con 0x7f43e40650f0 2020-11-20T11:50:52.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43e9a25700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e40650f0 0x7f43e40c3ac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f43d400c710 tx=0x7f43d4007c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43d27fc700 1 -- 172.21.15.164:0/3598158602 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4007020 con 0x7f43e40650f0 2020-11-20T11:50:52.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43d27fc700 1 -- 172.21.15.164:0/3598158602 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d4001e90 con 0x7f43e40650f0 2020-11-20T11:50:52.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43ec48a700 1 -- 172.21.15.164:0/3598158602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e41541f0 con 0x7f43e40650f0 2020-11-20T11:50:52.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43d27fc700 1 -- 172.21.15.164:0/3598158602 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40073b0 con 0x7f43e40650f0 2020-11-20T11:50:52.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.302+0000 7f43ec48a700 1 -- 172.21.15.164:0/3598158602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e41618f0 con 0x7f43e40650f0 2020-11-20T11:50:52.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.303+0000 7f43ec48a700 1 -- 172.21.15.164:0/3598158602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e40c37e0 con 0x7f43e40650f0 2020-11-20T11:50:52.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.304+0000 7f43d27fc700 1 -- 172.21.15.164:0/3598158602 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f43d401a060 con 0x7f43e40650f0 2020-11-20T11:50:52.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.304+0000 7f43d27fc700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f43bc080670 0x7f43bc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.304+0000 7f43d27fc700 1 -- 172.21.15.164:0/3598158602 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f43d40a2190 con 0x7f43e40650f0 2020-11-20T11:50:52.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.304+0000 7f43ea226700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f43bc080670 0x7f43bc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.305+0000 7f43ea226700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f43bc080670 0x7f43bc082b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f43e00011e0 tx=0x7f43e0007a40).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.308+0000 7f43d27fc700 1 -- 172.21.15.164:0/3598158602 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f43d4076ba0 con 0x7f43e40650f0 2020-11-20T11:50:52.452 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.448+0000 7f43ec48a700 1 -- 172.21.15.164:0/3598158602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43e4069b70 con 0x7f43e40650f0 2020-11-20T11:50:52.452 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.448+0000 7f43d27fc700 1 -- 172.21.15.164:0/3598158602 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7f43d4018030 con 0x7f43e40650f0 2020-11-20T11:50:52.453 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 8 2020-11-20T11:50:52.454 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 -- 172.21.15.164:0/3598158602 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f43bc080670 msgr2=0x7f43bc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.454 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f43bc080670 0x7f43bc082b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f43e00011e0 tx=0x7f43e0007a40).stop 2020-11-20T11:50:52.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 -- 172.21.15.164:0/3598158602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e40650f0 msgr2=0x7f43e40c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e40650f0 0x7f43e40c3ac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f43d400c710 tx=0x7f43d4007c90).stop 2020-11-20T11:50:52.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 -- 172.21.15.164:0/3598158602 shutdown_connections 2020-11-20T11:50:52.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f43bc080670 0x7f43bc082b30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.455 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43e4150d00 0x7f43e40c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43e4064d10 0x7f43e4155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 --2- 172.21.15.164:0/3598158602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43e40650f0 0x7f43e40c3ac0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 -- 172.21.15.164:0/3598158602 >> 172.21.15.164:0/3598158602 conn(0x7f43e40c55c0 msgr2=0x7f43e40bb730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:52.456 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 -- 172.21.15.164:0/3598158602 shutdown_connections 2020-11-20T11:50:52.457 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.450+0000 7f43ec48a700 1 -- 172.21.15.164:0/3598158602 wait complete. 2020-11-20T11:50:52.465 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:50:52.579 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.574+0000 7f19fe136700 1 Processor -- start 2020-11-20T11:50:52.580 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.574+0000 7f19fe136700 1 -- start start 2020-11-20T11:50:52.580 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19fe136700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f19f80c45e0 0x7f19f80bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.580 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19fe136700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f80c12b0 con 0x7f19f80c4200 2020-11-20T11:50:52.580 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19fe136700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f8151780 con 0x7f19f80bccf0 2020-11-20T11:50:52.581 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19fe136700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f80c4a30 con 0x7f19f80c45e0 2020-11-20T11:50:52.581 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19f7fff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f19f80c45e0 0x7f19f80bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.581 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19f77fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f19f80c4200 0x7f19f8150fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55728/0 (socket says 172.21.15.164:55728) 2020-11-20T11:50:52.581 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19f7fff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f19f80c45e0 0x7f19f80bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45990/0 (socket says 172.21.15.164:45990) 2020-11-20T11:50:52.581 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19f77fe700 1 -- 172.21.15.164:0/1490669968 learned_addr learned my addr 172.21.15.164:0/1490669968 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:52.582 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19f7fff700 1 -- 172.21.15.164:0/1490669968 >> v1:172.21.15.188:6789/0 conn(0x7f19f80bccf0 legacy=0x7f19f80c0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.582 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19f7fff700 1 -- 172.21.15.164:0/1490669968 >> v1:172.21.15.164:6789/0 conn(0x7f19f80c4200 legacy=0x7f19f8150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.582 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19f67fc700 1 -- 172.21.15.164:0/1490669968 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130277345 0 0) 0x7f19f80c12b0 con 0x7f19f80c4200 2020-11-20T11:50:52.582 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.575+0000 7f19f7fff700 1 -- 172.21.15.164:0/1490669968 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8151a20 con 0x7f19f80c45e0 2020-11-20T11:50:52.582 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19f7fff700 1 --2- 172.21.15.164:0/1490669968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 0x7f19f80bf550 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f19f80c0110 tx=0x7f19f0009220).ready entity=mon.1 client_cookie=edef34122ece0966 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.583 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19f67fc700 1 -- 172.21.15.164:0/1490669968 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f000bbf0 con 0x7f19f80c45e0 2020-11-20T11:50:52.583 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19f67fc700 1 -- 172.21.15.164:0/1490669968 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f000bd50 con 0x7f19f80c45e0 2020-11-20T11:50:52.583 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19f67fc700 1 -- 172.21.15.164:0/1490669968 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0011610 con 0x7f19f80c45e0 2020-11-20T11:50:52.586 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19fe136700 1 -- 172.21.15.164:0/1490669968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 msgr2=0x7f19f80bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.586 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19fe136700 1 --2- 172.21.15.164:0/1490669968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 0x7f19f80bf550 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f19f80c0110 tx=0x7f19f0009220).stop 2020-11-20T11:50:52.586 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19fe136700 1 -- 172.21.15.164:0/1490669968 shutdown_connections 2020-11-20T11:50:52.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19fe136700 1 --2- 172.21.15.164:0/1490669968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 0x7f19f80bf550 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19fe136700 1 -- 172.21.15.164:0/1490669968 >> 172.21.15.164:0/1490669968 conn(0x7f19f80678e0 msgr2=0x7f19f8067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:52.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19fe136700 1 -- 172.21.15.164:0/1490669968 shutdown_connections 2020-11-20T11:50:52.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.576+0000 7f19fe136700 1 -- 172.21.15.164:0/1490669968 wait complete. 2020-11-20T11:50:52.587 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.577+0000 7f19fe136700 1 Processor -- start 2020-11-20T11:50:52.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.577+0000 7f19fe136700 1 -- start start 2020-11-20T11:50:52.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.578+0000 7f19fe136700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19f80bccf0 0x7f19f8067e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.578+0000 7f19fe136700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19f80c4200 0x7f19f80c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.578+0000 7f19fe136700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 0x7f19f80c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.588 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.578+0000 7f19fe136700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f81635b0 con 0x7f19f80c4200 2020-11-20T11:50:52.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.578+0000 7f19fe136700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8163850 con 0x7f19f80c45e0 2020-11-20T11:50:52.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.578+0000 7f19fe136700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8163af0 con 0x7f19f80bccf0 2020-11-20T11:50:52.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.578+0000 7f19f7fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 0x7f19f80c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.578+0000 7f19f7fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 0x7f19f80c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45998/0 (socket says 172.21.15.164:45998) 2020-11-20T11:50:52.589 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.578+0000 7f19f7fff700 1 -- 172.21.15.164:0/1898820263 learned_addr learned my addr 172.21.15.164:0/1898820263 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:52.590 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.578+0000 7f19f77fe700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19f80bccf0 0x7f19f8067e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.590 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19f6ffd700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19f80c4200 0x7f19f80c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.590 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19f7fff700 1 -- 172.21.15.164:0/1898820263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19f80bccf0 msgr2=0x7f19f8067e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.590 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19f7fff700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19f80bccf0 0x7f19f8067e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.590 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19f7fff700 1 -- 172.21.15.164:0/1898820263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19f80c4200 msgr2=0x7f19f80c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19f7fff700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19f80c4200 0x7f19f80c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19f7fff700 1 -- 172.21.15.164:0/1898820263 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8163d90 con 0x7f19f80c45e0 2020-11-20T11:50:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19f6ffd700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19f80c4200 0x7f19f80c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19f7fff700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 0x7f19f80c5c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f19f00090b0 tx=0x7f19f0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19d77fe700 1 -- 172.21.15.164:0/1898820263 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0010800 con 0x7f19f80c45e0 2020-11-20T11:50:52.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19d77fe700 1 -- 172.21.15.164:0/1898820263 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f0010960 con 0x7f19f80c45e0 2020-11-20T11:50:52.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19fe136700 1 -- 172.21.15.164:0/1898820263 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f8164030 con 0x7f19f80c45e0 2020-11-20T11:50:52.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19d77fe700 1 -- 172.21.15.164:0/1898820263 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0010ce0 con 0x7f19f80c45e0 2020-11-20T11:50:52.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.579+0000 7f19fe136700 1 -- 172.21.15.164:0/1898820263 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f8068370 con 0x7f19f80c45e0 2020-11-20T11:50:52.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.580+0000 7f19fe136700 1 -- 172.21.15.164:0/1898820263 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f80685f0 con 0x7f19f80c45e0 2020-11-20T11:50:52.592 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.581+0000 7f19d77fe700 1 -- 172.21.15.164:0/1898820263 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f19f0017070 con 0x7f19f80c45e0 2020-11-20T11:50:52.593 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.581+0000 7f19d77fe700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f19d0080670 0x7f19d0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.593 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.581+0000 7f19f77fe700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f19d0080670 0x7f19d0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.593 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.581+0000 7f19d77fe700 1 -- 172.21.15.164:0/1898820263 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f19f00a5320 con 0x7f19f80c45e0 2020-11-20T11:50:52.593 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.581+0000 7f19f77fe700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f19d0080670 0x7f19d0082b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f19e80011e0 tx=0x7f19e8007a40).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.594 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.584+0000 7f19d77fe700 1 -- 172.21.15.164:0/1898820263 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f19f0079d30 con 0x7f19f80c45e0 2020-11-20T11:50:52.730 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.726+0000 7f19fe136700 1 -- 172.21.15.164:0/1898820263 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19f81641c0 con 0x7f19f80c45e0 2020-11-20T11:50:52.731 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.726+0000 7f19d77fe700 1 -- 172.21.15.164:0/1898820263 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7f19f0015070 con 0x7f19f80c45e0 2020-11-20T11:50:52.731 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 8 2020-11-20T11:50:52.733 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 -- 172.21.15.164:0/1898820263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f19d0080670 msgr2=0x7f19d0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.734 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f19d0080670 0x7f19d0082b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f19e80011e0 tx=0x7f19e8007a40).stop 2020-11-20T11:50:52.734 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 -- 172.21.15.164:0/1898820263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 msgr2=0x7f19f80c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.735 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 0x7f19f80c5c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f19f00090b0 tx=0x7f19f0016000).stop 2020-11-20T11:50:52.735 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 -- 172.21.15.164:0/1898820263 shutdown_connections 2020-11-20T11:50:52.735 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f19d0080670 0x7f19d0082b30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.736 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f80c45e0 0x7f19f80c5c90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.736 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19f80bccf0 0x7f19f8067e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.736 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 --2- 172.21.15.164:0/1898820263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19f80c4200 0x7f19f80c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.737 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 -- 172.21.15.164:0/1898820263 >> 172.21.15.164:0/1898820263 conn(0x7f19f80678e0 msgr2=0x7f19f81525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:52.737 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 -- 172.21.15.164:0/1898820263 shutdown_connections 2020-11-20T11:50:52.738 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.728+0000 7f19fe136700 1 -- 172.21.15.164:0/1898820263 wait complete. 2020-11-20T11:50:52.744 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:50:52.853 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.849+0000 7f5e89860700 1 Processor -- start 2020-11-20T11:50:52.854 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.850+0000 7f5e89860700 1 -- start start 2020-11-20T11:50:52.856 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.850+0000 7f5e89860700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5e840bf9a0 0x7f5e840bfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.856 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.850+0000 7f5e89860700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5e840c49b0 0x7f5e840c1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.857 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.850+0000 7f5e89860700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e841516d0 con 0x7f5e840c0bb0 2020-11-20T11:50:52.857 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.850+0000 7f5e89860700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e84151970 con 0x7f5e840c49b0 2020-11-20T11:50:52.857 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.850+0000 7f5e89860700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e84151c10 con 0x7f5e840bf9a0 2020-11-20T11:50:52.858 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e82ffd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5e840bf9a0 0x7f5e840bfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.858 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e82ffd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5e840bf9a0 0x7f5e840bfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46006/0 (socket says 172.21.15.164:46006) 2020-11-20T11:50:52.858 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e82ffd700 1 -- 172.21.15.164:0/2691269944 learned_addr learned my addr 172.21.15.164:0/2691269944 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:52.858 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e837fe700 1 --2- 172.21.15.164:0/2691269944 >> v2:172.21.15.36:3300/0 conn(0x7f5e840c49b0 0x7f5e840c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.858 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e82ffd700 1 -- 172.21.15.164:0/2691269944 >> v2:172.21.15.36:3300/0 conn(0x7f5e840c49b0 msgr2=0x7f5e840c1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:52.859 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e82ffd700 1 --2- 172.21.15.164:0/2691269944 >> v2:172.21.15.36:3300/0 conn(0x7f5e840c49b0 0x7f5e840c1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.859 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e82ffd700 1 -- 172.21.15.164:0/2691269944 >> v1:172.21.15.188:6789/0 conn(0x7f5e840c0bb0 legacy=0x7f5e840c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:52.859 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e82ffd700 1 -- 172.21.15.164:0/2691269944 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84151eb0 con 0x7f5e840bf9a0 2020-11-20T11:50:52.859 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e82ffd700 1 --2- 172.21.15.164:0/2691269944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 0x7f5e840bfd80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f5e840c87e0 tx=0x7f5e74006ef0).ready entity=mon.1 client_cookie=5b1819cc2a2c7ea7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.859 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e81ffb700 1 -- 172.21.15.164:0/2691269944 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400b860 con 0x7f5e840bf9a0 2020-11-20T11:50:52.860 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e81ffb700 1 -- 172.21.15.164:0/2691269944 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e74000e90 con 0x7f5e840bf9a0 2020-11-20T11:50:52.860 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.851+0000 7f5e81ffb700 1 -- 172.21.15.164:0/2691269944 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400bbd0 con 0x7f5e840bf9a0 2020-11-20T11:50:52.860 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.852+0000 7f5e89860700 1 -- 172.21.15.164:0/2691269944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 msgr2=0x7f5e840bfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.861 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.852+0000 7f5e89860700 1 --2- 172.21.15.164:0/2691269944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 0x7f5e840bfd80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f5e840c87e0 tx=0x7f5e74006ef0).stop 2020-11-20T11:50:52.861 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.852+0000 7f5e89860700 1 -- 172.21.15.164:0/2691269944 shutdown_connections 2020-11-20T11:50:52.861 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.852+0000 7f5e89860700 1 --2- 172.21.15.164:0/2691269944 >> v2:172.21.15.36:3300/0 conn(0x7f5e840c49b0 0x7f5e840c1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.862 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.852+0000 7f5e89860700 1 --2- 172.21.15.164:0/2691269944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 0x7f5e840bfd80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.862 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.852+0000 7f5e89860700 1 -- 172.21.15.164:0/2691269944 >> 172.21.15.164:0/2691269944 conn(0x7f5e840678e0 msgr2=0x7f5e84067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:52.862 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.852+0000 7f5e89860700 1 -- 172.21.15.164:0/2691269944 shutdown_connections 2020-11-20T11:50:52.863 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.852+0000 7f5e89860700 1 -- 172.21.15.164:0/2691269944 wait complete. 2020-11-20T11:50:52.863 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.853+0000 7f5e89860700 1 Processor -- start 2020-11-20T11:50:52.864 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.853+0000 7f5e89860700 1 -- start start 2020-11-20T11:50:52.868 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e89860700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 0x7f5e84156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.869 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e89860700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840c0bb0 0x7f5e841618f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.869 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e89860700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e840c49b0 0x7f5e840c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.869 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e89860700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84160ff0 con 0x7f5e840c49b0 2020-11-20T11:50:52.870 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e89860700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84161250 con 0x7f5e840bf9a0 2020-11-20T11:50:52.870 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e89860700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840c67d0 con 0x7f5e840c0bb0 2020-11-20T11:50:52.871 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e82ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 0x7f5e84156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.871 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e82ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 0x7f5e84156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46008/0 (socket says 172.21.15.164:46008) 2020-11-20T11:50:52.871 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e82ffd700 1 -- 172.21.15.164:0/2325005737 learned_addr learned my addr 172.21.15.164:0/2325005737 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:52.872 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e837fe700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e840c49b0 0x7f5e840c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.872 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e827fc700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840c0bb0 0x7f5e841618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.873 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e82ffd700 1 -- 172.21.15.164:0/2325005737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840c0bb0 msgr2=0x7f5e841618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.873 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e82ffd700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840c0bb0 0x7f5e841618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.873 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e82ffd700 1 -- 172.21.15.164:0/2325005737 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e840c49b0 msgr2=0x7f5e840c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:52.874 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e82ffd700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e840c49b0 0x7f5e840c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:52.874 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e82ffd700 1 -- 172.21.15.164:0/2325005737 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840c6a70 con 0x7f5e840bf9a0 2020-11-20T11:50:52.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e827fc700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840c0bb0 0x7f5e841618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:52.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e82ffd700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 0x7f5e84156e90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f5e7400c010 tx=0x7f5e74016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.875 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e6affd700 1 -- 172.21.15.164:0/2325005737 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74011be0 con 0x7f5e840bf9a0 2020-11-20T11:50:52.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e6affd700 1 -- 172.21.15.164:0/2325005737 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e74011d40 con 0x7f5e840bf9a0 2020-11-20T11:50:52.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e89860700 1 -- 172.21.15.164:0/2325005737 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e840c6d10 con 0x7f5e840bf9a0 2020-11-20T11:50:52.876 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e6affd700 1 -- 172.21.15.164:0/2325005737 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7401d6d0 con 0x7f5e840bf9a0 2020-11-20T11:50:52.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.854+0000 7f5e89860700 1 -- 172.21.15.164:0/2325005737 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e840c76a0 con 0x7f5e840bf9a0 2020-11-20T11:50:52.877 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.855+0000 7f5e89860700 1 -- 172.21.15.164:0/2325005737 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e84069b70 con 0x7f5e840bf9a0 2020-11-20T11:50:52.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.856+0000 7f5e6affd700 1 -- 172.21.15.164:0/2325005737 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5e74017070 con 0x7f5e840bf9a0 2020-11-20T11:50:52.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.856+0000 7f5e6affd700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e60080670 0x7f5e60082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:52.878 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.856+0000 7f5e6affd700 1 -- 172.21.15.164:0/2325005737 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f5e740a4730 con 0x7f5e840bf9a0 2020-11-20T11:50:52.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.856+0000 7f5e827fc700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e60080670 0x7f5e60082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:52.879 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.857+0000 7f5e827fc700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e60080670 0x7f5e60082b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f5e840c51e0 tx=0x7f5e78009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:52.880 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:52.860+0000 7f5e6affd700 1 -- 172.21.15.164:0/2325005737 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5e74079140 con 0x7f5e840bf9a0 2020-11-20T11:50:53.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.046+0000 7f5e89860700 1 -- 172.21.15.164:0/2325005737 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e84060540 con 0x7f5e840bf9a0 2020-11-20T11:50:53.051 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.046+0000 7f5e6affd700 1 -- 172.21.15.164:0/2325005737 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2489 (secure 0 0 0) 0x7f5e74015070 con 0x7f5e840bf9a0 2020-11-20T11:50:53.051 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:53.051 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1360026757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1360026757},{"type":"v1","addr":"172.21.15.164:6835","nonce":1360026757}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3921177334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3921177334},{"type":"v1","addr":"172.21.15.188:6833","nonce":3921177334}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:50:39.612795+0000","modified":"2020-11-20T11:50:41.621570+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6833/1888702035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":1888702035},{"type":"v1","addr":"172.21.15.36:6833","nonce":1888702035}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:50:53.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 -- 172.21.15.164:0/2325005737 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e60080670 msgr2=0x7f5e60082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:53.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e60080670 0x7f5e60082b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f5e840c51e0 tx=0x7f5e78009040).stop 2020-11-20T11:50:53.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 -- 172.21.15.164:0/2325005737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 msgr2=0x7f5e84156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:53.054 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 0x7f5e84156e90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f5e7400c010 tx=0x7f5e74016000).stop 2020-11-20T11:50:53.054 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 -- 172.21.15.164:0/2325005737 shutdown_connections 2020-11-20T11:50:53.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f5e60080670 0x7f5e60082b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:53.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5e840bf9a0 0x7f5e84156e90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:53.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e840c49b0 0x7f5e840c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:53.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 --2- 172.21.15.164:0/2325005737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e840c0bb0 0x7f5e841618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:53.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 -- 172.21.15.164:0/2325005737 >> 172.21.15.164:0/2325005737 conn(0x7f5e840678e0 msgr2=0x7f5e840c31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:53.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 -- 172.21.15.164:0/2325005737 shutdown_connections 2020-11-20T11:50:53.057 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:53.048+0000 7f5e89860700 1 -- 172.21.15.164:0/2325005737 wait complete. 2020-11-20T11:50:53.057 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 7 2020-11-20T11:50:53.366 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T11:50:39.612795+0000', 'modified': '2020-11-20T11:50:41.621570+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4321}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4321': {'gid': 4321, 'name': 'b', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6833/1888702035', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6832', 'nonce': 1888702035}, {'type': 'v1', 'addr': '172.21.15.36:6833', 'nonce': 1888702035}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T11:50:53.367 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T11:50:53.368 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-11-20T11:50:53.518 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","whoami":0,"id":4321,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.891421305,"mdsmap_epoch":7,"osdmap_epoch":28,"osdmap_epoch_barrier":28,"uptime":20.256205975} 2020-11-20T11:50:53.519 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "8d9b76f1-9267-4076-877e-b8d77372c9f3", "fs_name": "cephfs", "id": 4321, "mdsmap_epoch": 7, "osdmap_epoch": 28, "osdmap_epoch_barrier": 28, "rank_uptime": 13.891421305, "state": "up:active", "uptime": 20.256205975, "want_state": "up:active", "whoami": 0 } 2020-11-20T11:50:53.519 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-11-20T11:50:53.552 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-11-20T11:50:53.553 INFO:tasks.ceph_fuse:config is None 2020-11-20T11:50:53.554 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-11-20T11:50:53.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:53.555 INFO:teuthology.orchestra.run.smithi164:> ip netns list 2020-11-20T11:50:53.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:53.579 INFO:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2020-11-20T11:50:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2020-11-20T11:50:53.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:50:53.651 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-11-20T11:50:53.651 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2020-11-20T11:50:53.652 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2020-11-20T11:50:53.653 INFO:tasks.cephfs.mount:self.client.name = client.0 2020-11-20T11:50:53.653 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2020-11-20T11:50:53.653 INFO:tasks.cephfs.mount:self.cephfs_name = None 2020-11-20T11:50:53.654 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2020-11-20T11:50:53.657 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2020-11-20T11:50:53.658 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-11-20T11:50:53.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:53.659 INFO:teuthology.orchestra.run.smithi164:> ip addr 2020-11-20T11:50:53.710 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-11-20T11:50:53.710 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-11-20T11:50:53.711 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2020-11-20T11:50:53.711 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:50:53.712 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2020-11-20T11:50:53.712 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:50:53.712 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:50:53.713 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:50:53.713 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:50:53.713 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:50:53.714 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:50:53.714 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:50:53.715 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-11-20T11:50:53.715 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:50:53.715 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-11-20T11:50:53.716 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42781sec preferred_lft 42781sec 2020-11-20T11:50:53.716 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2020-11-20T11:50:53.717 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:50:53.718 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-11-20T11:50:53.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:53.719 INFO:teuthology.orchestra.run.smithi164:> (cd / && exec sudo bash -c ' 2020-11-20T11:50:53.720 INFO:teuthology.orchestra.run.smithi164:> set -e 2020-11-20T11:50:53.720 INFO:teuthology.orchestra.run.smithi164:> sudo ip link add name ceph-brx type bridge 2020-11-20T11:50:53.721 INFO:teuthology.orchestra.run.smithi164:> sudo ip addr flush dev ceph-brx 2020-11-20T11:50:53.721 INFO:teuthology.orchestra.run.smithi164:> sudo ip link set ceph-brx up 2020-11-20T11:50:53.722 INFO:teuthology.orchestra.run.smithi164:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2020-11-20T11:50:53.723 INFO:teuthology.orchestra.run.smithi164:> ') 2020-11-20T11:50:53.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:53.883 INFO:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-11-20T11:50:53.918 INFO:teuthology.orchestra.run.smithi164.stdout:1 2020-11-20T11:50:53.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:53.920 INFO:teuthology.orchestra.run.smithi164:> route 2020-11-20T11:50:53.992 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2020-11-20T11:50:53.992 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-11-20T11:50:53.993 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-11-20T11:50:53.993 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2020-11-20T11:50:53.993 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-11-20T11:50:53.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:53.995 INFO:teuthology.orchestra.run.smithi164:> (cd / && exec sudo bash -c ' 2020-11-20T11:50:53.995 INFO:teuthology.orchestra.run.smithi164:> set -e 2020-11-20T11:50:53.996 INFO:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2020-11-20T11:50:53.996 INFO:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2020-11-20T11:50:53.997 INFO:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2020-11-20T11:50:53.997 INFO:teuthology.orchestra.run.smithi164:> ') 2020-11-20T11:50:54.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:54.230 INFO:teuthology.orchestra.run.smithi164:> ip netns list 2020-11-20T11:50:54.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:54.253 INFO:teuthology.orchestra.run.smithi164:> ip netns list-id 2020-11-20T11:50:54.297 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:54.308 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:54.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:54.322 INFO:teuthology.orchestra.run.smithi164:> (cd / && exec sudo bash -c ' 2020-11-20T11:50:54.322 INFO:teuthology.orchestra.run.smithi164:> set -e 2020-11-20T11:50:54.322 INFO:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T11:50:54.323 INFO:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2020-11-20T11:50:54.323 INFO:teuthology.orchestra.run.smithi164:> ') 2020-11-20T11:50:54.325 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:54.460 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-11-20T11:50:54.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:54.461 INFO:teuthology.orchestra.run.smithi164:> (cd / && exec sudo bash -c ' 2020-11-20T11:50:54.462 INFO:teuthology.orchestra.run.smithi164:> set -e 2020-11-20T11:50:54.463 INFO:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2020-11-20T11:50:54.464 INFO:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2020-11-20T11:50:54.465 INFO:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2020-11-20T11:50:54.471 INFO:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2020-11-20T11:50:54.472 INFO:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2020-11-20T11:50:54.472 INFO:teuthology.orchestra.run.smithi164:> ') 2020-11-20T11:50:54.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:50:54.689 INFO:teuthology.orchestra.run.smithi164:> (cd / && exec sudo bash -c ' 2020-11-20T11:50:54.689 INFO:teuthology.orchestra.run.smithi164:> set -e 2020-11-20T11:50:54.690 INFO:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2020-11-20T11:50:54.690 INFO:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.0 master ceph-brx 2020-11-20T11:50:54.690 INFO:teuthology.orchestra.run.smithi164:> ') 2020-11-20T11:50:54.788 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:50:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.898+0000 7fa837bc5700 1 Processor -- start 2020-11-20T11:50:54.903 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.899+0000 7fa837bc5700 1 -- start start 2020-11-20T11:50:54.904 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.899+0000 7fa837bc5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa8300c4360 0x7fa8300c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:54.905 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.899+0000 7fa837bc5700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa830151220 con 0x7fa830150520 2020-11-20T11:50:54.905 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.899+0000 7fa837bc5700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8301514c0 con 0x7fa8301550f0 2020-11-20T11:50:54.905 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.899+0000 7fa837bc5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8300bd090 con 0x7fa8300c4360 2020-11-20T11:50:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa835160700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fa8301550f0 0x7fa8300bfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.164:41072/0 (socket says 172.21.15.164:41072) 2020-11-20T11:50:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa835160700 1 -- 172.21.15.164:0/3749511490 learned_addr learned my addr 172.21.15.164:0/3749511490 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa835961700 1 --2- 172.21.15.164:0/3749511490 >> v2:172.21.15.36:3300/0 conn(0x7fa8300c4360 0x7fa8300c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa83495f700 1 -- 172.21.15.164:0/3749511490 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698995815 0 0) 0x7fa8301514c0 con 0x7fa8301550f0 2020-11-20T11:50:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa83495f700 1 -- 172.21.15.164:0/3749511490 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa818003280 con 0x7fa8301550f0 2020-11-20T11:50:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa835961700 1 -- 172.21.15.164:0/3749511490 >> v1:172.21.15.188:6789/0 conn(0x7fa8301550f0 legacy=0x7fa8300bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:54.911 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa83495f700 1 -- 172.21.15.164:0/3749511490 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313544073 0 0) 0x7fa830151220 con 0x7fa830150520 2020-11-20T11:50:54.911 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa835961700 1 -- 172.21.15.164:0/3749511490 >> v1:172.21.15.36:6789/0 conn(0x7fa830150520 legacy=0x7fa830150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:54.911 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa835961700 1 -- 172.21.15.164:0/3749511490 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830151760 con 0x7fa8300c4360 2020-11-20T11:50:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa835961700 1 --2- 172.21.15.164:0/3749511490 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8300c4360 0x7fa8300c4740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa82c006fd0 tx=0x7fa82c006e30).ready entity=mon.0 client_cookie=5f59680750155112 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.900+0000 7fa83495f700 1 -- 172.21.15.164:0/3749511490 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00bec0 con 0x7fa8300c4360 2020-11-20T11:50:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.901+0000 7fa83495f700 1 -- 172.21.15.164:0/3749511490 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c000e90 con 0x7fa8300c4360 2020-11-20T11:50:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.901+0000 7fa83495f700 1 -- 172.21.15.164:0/3749511490 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0099f0 con 0x7fa8300c4360 2020-11-20T11:50:54.913 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.901+0000 7fa837bc5700 1 -- 172.21.15.164:0/3749511490 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8300c4360 msgr2=0x7fa8300c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:54.913 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.901+0000 7fa837bc5700 1 --2- 172.21.15.164:0/3749511490 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8300c4360 0x7fa8300c4740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa82c006fd0 tx=0x7fa82c006e30).stop 2020-11-20T11:50:54.913 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.901+0000 7fa837bc5700 1 -- 172.21.15.164:0/3749511490 shutdown_connections 2020-11-20T11:50:54.914 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.901+0000 7fa837bc5700 1 --2- 172.21.15.164:0/3749511490 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8300c4360 0x7fa8300c4740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:54.914 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.901+0000 7fa837bc5700 1 -- 172.21.15.164:0/3749511490 >> 172.21.15.164:0/3749511490 conn(0x7fa8300619e0 msgr2=0x7fa830061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:54.914 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.901+0000 7fa837bc5700 1 -- 172.21.15.164:0/3749511490 shutdown_connections 2020-11-20T11:50:54.914 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.901+0000 7fa837bc5700 1 -- 172.21.15.164:0/3749511490 wait complete. 2020-11-20T11:50:54.914 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.902+0000 7fa837bc5700 1 Processor -- start 2020-11-20T11:50:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.902+0000 7fa837bc5700 1 -- start start 2020-11-20T11:50:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa837bc5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8300c4360 0x7fa83014d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa837bc5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa830150520 0x7fa830160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa837bc5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8301550f0 0x7fa830112150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa837bc5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa830161190 con 0x7fa8300c4360 2020-11-20T11:50:54.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa837bc5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83014db30 con 0x7fa830150520 2020-11-20T11:50:54.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa837bc5700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83014ddd0 con 0x7fa8301550f0 2020-11-20T11:50:54.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa835160700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa830150520 0x7fa830160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:54.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa835160700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa830150520 0x7fa830160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46024/0 (socket says 172.21.15.164:46024) 2020-11-20T11:50:54.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa835160700 1 -- 172.21.15.164:0/972826894 learned_addr learned my addr 172.21.15.164:0/972826894 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:54.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa836162700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8301550f0 0x7fa830112150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:54.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.903+0000 7fa835961700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8300c4360 0x7fa83014d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:54.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa835160700 1 -- 172.21.15.164:0/972826894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8301550f0 msgr2=0x7fa830112150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:54.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa835160700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8301550f0 0x7fa830112150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:54.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa835160700 1 -- 172.21.15.164:0/972826894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8300c4360 msgr2=0x7fa83014d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa835160700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8300c4360 0x7fa83014d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa835160700 1 -- 172.21.15.164:0/972826894 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83014e070 con 0x7fa830150520 2020-11-20T11:50:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa835160700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa830150520 0x7fa830160ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa82000c7a0 tx=0x7fa820007b10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa81dffb700 1 -- 172.21.15.164:0/972826894 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820007320 con 0x7fa830150520 2020-11-20T11:50:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa81dffb700 1 -- 172.21.15.164:0/972826894 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa820007480 con 0x7fa830150520 2020-11-20T11:50:54.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa837bc5700 1 -- 172.21.15.164:0/972826894 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa830156bd0 con 0x7fa830150520 2020-11-20T11:50:54.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa81dffb700 1 -- 172.21.15.164:0/972826894 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820005840 con 0x7fa830150520 2020-11-20T11:50:54.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.904+0000 7fa837bc5700 1 -- 172.21.15.164:0/972826894 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa830157110 con 0x7fa830150520 2020-11-20T11:50:54.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.905+0000 7fa837bc5700 1 -- 172.21.15.164:0/972826894 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8301572a0 con 0x7fa830150520 2020-11-20T11:50:54.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.905+0000 7fa81dffb700 1 -- 172.21.15.164:0/972826894 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa820010030 con 0x7fa830150520 2020-11-20T11:50:54.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.906+0000 7fa81dffb700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa8080806a0 0x7fa808082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:54.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.906+0000 7fa81dffb700 1 -- 172.21.15.164:0/972826894 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa8200a26a0 con 0x7fa830150520 2020-11-20T11:50:54.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.906+0000 7fa835961700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa8080806a0 0x7fa808082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:54.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.906+0000 7fa835961700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa8080806a0 0x7fa808082b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa82c006e70 tx=0x7fa82c015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:54.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:54.909+0000 7fa81dffb700 1 -- 172.21.15.164:0/972826894 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa820077130 con 0x7fa830150520 2020-11-20T11:50:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.048+0000 7fa837bc5700 1 -- 172.21.15.164:0/972826894 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa830069b70 con 0x7fa830150520 2020-11-20T11:50:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.049+0000 7fa81dffb700 1 -- 172.21.15.164:0/972826894 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7fa82007a750 con 0x7fa830150520 2020-11-20T11:50:55.053 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:55.054 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:39.612589+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:50:34.615204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:50:37.302647+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:50:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 -- 172.21.15.164:0/972826894 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa8080806a0 msgr2=0x7fa808082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa8080806a0 0x7fa808082b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa82c006e70 tx=0x7fa82c015000).stop 2020-11-20T11:50:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 -- 172.21.15.164:0/972826894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa830150520 msgr2=0x7fa830160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa830150520 0x7fa830160ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa82000c7a0 tx=0x7fa820007b10).stop 2020-11-20T11:50:55.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 -- 172.21.15.164:0/972826894 shutdown_connections 2020-11-20T11:50:55.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa8080806a0 0x7fa808082b60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8301550f0 0x7fa830112150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8300c4360 0x7fa83014d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.057 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 --2- 172.21.15.164:0/972826894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa830150520 0x7fa830160ca0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.057 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 -- 172.21.15.164:0/972826894 >> 172.21.15.164:0/972826894 conn(0x7fa8300619e0 msgr2=0x7fa8300c0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 -- 172.21.15.164:0/972826894 shutdown_connections 2020-11-20T11:50:55.058 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.051+0000 7fa837bc5700 1 -- 172.21.15.164:0/972826894 wait complete. 2020-11-20T11:50:55.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:50:22.130897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:50:32.016548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:50:34.615204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:50:37.302647+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:50:55.067 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:50:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.176+0000 7efd9daa2700 1 Processor -- start 2020-11-20T11:50:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.176+0000 7efd9daa2700 1 -- start start 2020-11-20T11:50:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd9daa2700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efd980bccf0 0x7efd980c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd9daa2700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd981555a0 con 0x7efd980c4470 2020-11-20T11:50:55.183 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd9daa2700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd981517d0 con 0x7efd980bf680 2020-11-20T11:50:55.183 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd9daa2700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd98151a70 con 0x7efd980bccf0 2020-11-20T11:50:55.183 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd96ffd700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efd980bccf0 0x7efd980c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.183 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd96ffd700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efd980bccf0 0x7efd980c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.164:39298/0 (socket says 172.21.15.164:39298) 2020-11-20T11:50:55.183 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd96ffd700 1 -- 172.21.15.164:0/4237691710 learned_addr learned my addr 172.21.15.164:0/4237691710 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:55.184 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd977fe700 1 --1- 172.21.15.164:0/4237691710 >> v1:172.21.15.36:6789/0 conn(0x7efd980c4470 0x7efd980c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.164:41902/0 (socket says 172.21.15.164:41902) 2020-11-20T11:50:55.184 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd97fff700 1 --1- 172.21.15.164:0/4237691710 >> v1:172.21.15.188:6789/0 conn(0x7efd980bf680 0x7efd981504b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.164:41088/0 (socket says 172.21.15.164:41088) 2020-11-20T11:50:55.184 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd96ffd700 1 -- 172.21.15.164:0/4237691710 >> v1:172.21.15.188:6789/0 conn(0x7efd980bf680 legacy=0x7efd981504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.184 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd96ffd700 1 -- 172.21.15.164:0/4237691710 >> v1:172.21.15.36:6789/0 conn(0x7efd980c4470 legacy=0x7efd980c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.185 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd967fc700 1 -- 172.21.15.164:0/4237691710 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767396034 0 0) 0x7efd981517d0 con 0x7efd980bf680 2020-11-20T11:50:55.185 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd96ffd700 1 -- 172.21.15.164:0/4237691710 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98151d10 con 0x7efd980bccf0 2020-11-20T11:50:55.185 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.177+0000 7efd96ffd700 1 --2- 172.21.15.164:0/4237691710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd980bccf0 0x7efd980c4850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7efd88009a10 tx=0x7efd88006ef0).ready entity=mon.2 client_cookie=7ae34a3bd4b1efa4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:55.185 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.178+0000 7efd967fc700 1 -- 172.21.15.164:0/4237691710 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8800b8f0 con 0x7efd980bccf0 2020-11-20T11:50:55.185 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.178+0000 7efd967fc700 1 -- 172.21.15.164:0/4237691710 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd88000e90 con 0x7efd980bccf0 2020-11-20T11:50:55.186 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.178+0000 7efd967fc700 1 -- 172.21.15.164:0/4237691710 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8800bc60 con 0x7efd980bccf0 2020-11-20T11:50:55.186 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.178+0000 7efd9daa2700 1 -- 172.21.15.164:0/4237691710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd980bccf0 msgr2=0x7efd980c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.186 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.178+0000 7efd9daa2700 1 --2- 172.21.15.164:0/4237691710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd980bccf0 0x7efd980c4850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7efd88009a10 tx=0x7efd88006ef0).stop 2020-11-20T11:50:55.186 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.178+0000 7efd9daa2700 1 -- 172.21.15.164:0/4237691710 shutdown_connections 2020-11-20T11:50:55.187 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.178+0000 7efd9daa2700 1 --2- 172.21.15.164:0/4237691710 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd980bccf0 0x7efd980c4850 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.187 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.178+0000 7efd9daa2700 1 -- 172.21.15.164:0/4237691710 >> 172.21.15.164:0/4237691710 conn(0x7efd980683b0 msgr2=0x7efd98061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:55.187 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.178+0000 7efd9daa2700 1 -- 172.21.15.164:0/4237691710 shutdown_connections 2020-11-20T11:50:55.187 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.178+0000 7efd9daa2700 1 -- 172.21.15.164:0/4237691710 wait complete. 2020-11-20T11:50:55.189 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.179+0000 7efd9daa2700 1 Processor -- start 2020-11-20T11:50:55.189 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.179+0000 7efd9daa2700 1 -- start start 2020-11-20T11:50:55.190 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd9daa2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd980bccf0 0x7efd98153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.190 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd9daa2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efd980bf680 0x7efd980c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.190 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd9daa2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd980c4470 0x7efd98161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.190 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd9daa2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd980c5ac0 con 0x7efd980bf680 2020-11-20T11:50:55.190 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd9daa2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd980c6530 con 0x7efd980bccf0 2020-11-20T11:50:55.191 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd9daa2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd980c7630 con 0x7efd980c4470 2020-11-20T11:50:55.191 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd977fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd980bccf0 0x7efd98153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.191 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd977fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd980bccf0 0x7efd98153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46036/0 (socket says 172.21.15.164:46036) 2020-11-20T11:50:55.191 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd977fe700 1 -- 172.21.15.164:0/3930984808 learned_addr learned my addr 172.21.15.164:0/3930984808 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:55.192 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd97fff700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd980c4470 0x7efd98161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.192 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd96ffd700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efd980bf680 0x7efd980c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.192 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd977fe700 1 -- 172.21.15.164:0/3930984808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd980c4470 msgr2=0x7efd98161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.192 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd977fe700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd980c4470 0x7efd98161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.192 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd977fe700 1 -- 172.21.15.164:0/3930984808 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efd980bf680 msgr2=0x7efd980c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd977fe700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efd980bf680 0x7efd980c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.180+0000 7efd977fe700 1 -- 172.21.15.164:0/3930984808 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98113030 con 0x7efd980bccf0 2020-11-20T11:50:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.181+0000 7efd977fe700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd980bccf0 0x7efd98153010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7efd8c00c710 tx=0x7efd8c007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.181+0000 7efd777fe700 1 -- 172.21.15.164:0/3930984808 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0072e0 con 0x7efd980bccf0 2020-11-20T11:50:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.181+0000 7efd777fe700 1 -- 172.21.15.164:0/3930984808 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8c005570 con 0x7efd980bccf0 2020-11-20T11:50:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.181+0000 7efd777fe700 1 -- 172.21.15.164:0/3930984808 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c005910 con 0x7efd980bccf0 2020-11-20T11:50:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.181+0000 7efd9daa2700 1 -- 172.21.15.164:0/3930984808 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd981132d0 con 0x7efd980bccf0 2020-11-20T11:50:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.181+0000 7efd9daa2700 1 -- 172.21.15.164:0/3930984808 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd980c6ca0 con 0x7efd980bccf0 2020-11-20T11:50:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.182+0000 7efd9daa2700 1 -- 172.21.15.164:0/3930984808 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd980c6ae0 con 0x7efd980bccf0 2020-11-20T11:50:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.182+0000 7efd777fe700 1 -- 172.21.15.164:0/3930984808 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7efd8c010070 con 0x7efd980bccf0 2020-11-20T11:50:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.183+0000 7efd777fe700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7efd700806a0 0x7efd70082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.183+0000 7efd777fe700 1 -- 172.21.15.164:0/3930984808 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7efd8c0a20d0 con 0x7efd980bccf0 2020-11-20T11:50:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.183+0000 7efd96ffd700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7efd700806a0 0x7efd70082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.183+0000 7efd96ffd700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7efd700806a0 0x7efd70082b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7efd88009a10 tx=0x7efd88016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.186+0000 7efd777fe700 1 -- 172.21.15.164:0/3930984808 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7efd8c076a60 con 0x7efd980bccf0 2020-11-20T11:50:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.328+0000 7efd9daa2700 1 -- 172.21.15.164:0/3930984808 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efd98151ef0 con 0x7efd980bccf0 2020-11-20T11:50:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.328+0000 7efd777fe700 1 -- 172.21.15.164:0/3930984808 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7efd8c07a080 con 0x7efd980bccf0 2020-11-20T11:50:55.332 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2020-11-20T11:50:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 -- 172.21.15.164:0/3930984808 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7efd700806a0 msgr2=0x7efd70082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7efd700806a0 0x7efd70082b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7efd88009a10 tx=0x7efd88016000).stop 2020-11-20T11:50:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 -- 172.21.15.164:0/3930984808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd980bccf0 msgr2=0x7efd98153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd980bccf0 0x7efd98153010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7efd8c00c710 tx=0x7efd8c007ca0).stop 2020-11-20T11:50:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 -- 172.21.15.164:0/3930984808 shutdown_connections 2020-11-20T11:50:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7efd700806a0 0x7efd70082b60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd980bccf0 0x7efd98153010 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd980c4470 0x7efd98161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 --2- 172.21.15.164:0/3930984808 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efd980bf680 0x7efd980c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.336 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 -- 172.21.15.164:0/3930984808 >> 172.21.15.164:0/3930984808 conn(0x7efd980683b0 msgr2=0x7efd980c0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:55.336 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 -- 172.21.15.164:0/3930984808 shutdown_connections 2020-11-20T11:50:55.336 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.330+0000 7efd9daa2700 1 -- 172.21.15.164:0/3930984808 wait complete. 2020-11-20T11:50:55.345 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:50:55.457 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.453+0000 7f767dfb8700 1 Processor -- start 2020-11-20T11:50:55.458 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.453+0000 7f767dfb8700 1 -- start start 2020-11-20T11:50:55.465 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.454+0000 7f767dfb8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f76780c45e0 0x7f76780bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.466 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.454+0000 7f767dfb8700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76780c12b0 con 0x7f76780c4200 2020-11-20T11:50:55.466 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.454+0000 7f767dfb8700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7678151780 con 0x7f76780bccf0 2020-11-20T11:50:55.466 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.454+0000 7f767dfb8700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76780c4a30 con 0x7f76780c45e0 2020-11-20T11:50:55.467 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.454+0000 7f7676ffd700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f76780bccf0 0x7f76780c0ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55784/0 (socket says 172.21.15.164:55784) 2020-11-20T11:50:55.467 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.454+0000 7f7676ffd700 1 -- 172.21.15.164:0/2350360761 learned_addr learned my addr 172.21.15.164:0/2350360761 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:55.467 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.454+0000 7f7677fff700 1 --2- 172.21.15.164:0/2350360761 >> v2:172.21.15.36:3300/0 conn(0x7f76780c45e0 0x7f76780bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.468 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.455+0000 7f76767fc700 1 -- 172.21.15.164:0/2350360761 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917389250 0 0) 0x7f7678151780 con 0x7f76780bccf0 2020-11-20T11:50:55.468 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.455+0000 7f76767fc700 1 -- 172.21.15.164:0/2350360761 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7664003280 con 0x7f76780bccf0 2020-11-20T11:50:55.468 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.455+0000 7f76767fc700 1 -- 172.21.15.164:0/2350360761 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2284876071 0 0) 0x7f7664003280 con 0x7f76780bccf0 2020-11-20T11:50:55.469 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.455+0000 7f7677fff700 1 -- 172.21.15.164:0/2350360761 >> v1:172.21.15.164:6789/0 conn(0x7f76780bccf0 legacy=0x7f76780c0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.469 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.455+0000 7f7677fff700 1 -- 172.21.15.164:0/2350360761 >> v1:172.21.15.36:6789/0 conn(0x7f76780c4200 legacy=0x7f7678150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.469 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.455+0000 7f7677fff700 1 -- 172.21.15.164:0/2350360761 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678151a20 con 0x7f76780c45e0 2020-11-20T11:50:55.470 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.455+0000 7f7677fff700 1 --2- 172.21.15.164:0/2350360761 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76780c45e0 0x7f76780bf550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f76780c0110 tx=0x7f7670009220).ready entity=mon.0 client_cookie=6f4ebd30f7947d95 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:55.470 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.455+0000 7f76767fc700 1 -- 172.21.15.164:0/2350360761 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c001520 con 0x7f76780c45e0 2020-11-20T11:50:55.471 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.455+0000 7f76767fc700 1 -- 172.21.15.164:0/2350360761 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767000b680 con 0x7f76780c45e0 2020-11-20T11:50:55.471 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.455+0000 7f76767fc700 1 -- 172.21.15.164:0/2350360761 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767000ba00 con 0x7f76780c45e0 2020-11-20T11:50:55.471 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.456+0000 7f767dfb8700 1 -- 172.21.15.164:0/2350360761 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76780c45e0 msgr2=0x7f76780bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.472 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.456+0000 7f767dfb8700 1 --2- 172.21.15.164:0/2350360761 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76780c45e0 0x7f76780bf550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f76780c0110 tx=0x7f7670009220).stop 2020-11-20T11:50:55.472 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.456+0000 7f767dfb8700 1 -- 172.21.15.164:0/2350360761 shutdown_connections 2020-11-20T11:50:55.472 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.456+0000 7f767dfb8700 1 --2- 172.21.15.164:0/2350360761 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76780c45e0 0x7f76780bf550 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.473 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.456+0000 7f767dfb8700 1 -- 172.21.15.164:0/2350360761 >> 172.21.15.164:0/2350360761 conn(0x7f76780678e0 msgr2=0x7f7678067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:55.473 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.456+0000 7f767dfb8700 1 -- 172.21.15.164:0/2350360761 shutdown_connections 2020-11-20T11:50:55.473 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.456+0000 7f767dfb8700 1 -- 172.21.15.164:0/2350360761 wait complete. 2020-11-20T11:50:55.474 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.457+0000 7f767dfb8700 1 Processor -- start 2020-11-20T11:50:55.474 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.457+0000 7f767dfb8700 1 -- start start 2020-11-20T11:50:55.474 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f767dfb8700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76780bccf0 0x7f76780c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.475 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f767dfb8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76780c4200 0x7f7678163ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.475 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f767dfb8700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f76780c45e0 0x7f76781613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.475 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f767dfb8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780c2400 con 0x7f76780c4200 2020-11-20T11:50:55.476 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f767dfb8700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7678164390 con 0x7f76780c45e0 2020-11-20T11:50:55.476 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f767dfb8700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7678112e90 con 0x7f76780bccf0 2020-11-20T11:50:55.476 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f7677fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f76780c45e0 0x7f76781613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.477 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f7677fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f76780c45e0 0x7f76781613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46054/0 (socket says 172.21.15.164:46054) 2020-11-20T11:50:55.477 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f7677fff700 1 -- 172.21.15.164:0/1767706588 learned_addr learned my addr 172.21.15.164:0/1767706588 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:55.477 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f7676ffd700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76780c4200 0x7f7678163ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.478 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f76777fe700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76780bccf0 0x7f76780c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.478 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f7677fff700 1 -- 172.21.15.164:0/1767706588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76780bccf0 msgr2=0x7f76780c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.478 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f7677fff700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76780bccf0 0x7f76780c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.479 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f7677fff700 1 -- 172.21.15.164:0/1767706588 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76780c4200 msgr2=0x7f7678163ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.479 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f7677fff700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76780c4200 0x7f7678163ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.480 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f7677fff700 1 -- 172.21.15.164:0/1767706588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678113130 con 0x7f76780c45e0 2020-11-20T11:50:55.480 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f76777fe700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76780bccf0 0x7f76780c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:55.480 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f7677fff700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f76780c45e0 0x7f76781613e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f7670006f40 tx=0x7f76780c7720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:55.481 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f76577fe700 1 -- 172.21.15.164:0/1767706588 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670020070 con 0x7f76780c45e0 2020-11-20T11:50:55.481 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f76577fe700 1 -- 172.21.15.164:0/1767706588 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7670011e40 con 0x7f76780c45e0 2020-11-20T11:50:55.481 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f767dfb8700 1 -- 172.21.15.164:0/1767706588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76780c2630 con 0x7f76780c45e0 2020-11-20T11:50:55.482 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f76577fe700 1 -- 172.21.15.164:0/1767706588 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670005ce0 con 0x7f76780c45e0 2020-11-20T11:50:55.482 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.458+0000 7f767dfb8700 1 -- 172.21.15.164:0/1767706588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76780c2b70 con 0x7f76780c45e0 2020-11-20T11:50:55.482 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.459+0000 7f767dfb8700 1 -- 172.21.15.164:0/1767706588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76780c2d30 con 0x7f76780c45e0 2020-11-20T11:50:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.460+0000 7f76577fe700 1 -- 172.21.15.164:0/1767706588 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f767000f070 con 0x7f76780c45e0 2020-11-20T11:50:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.460+0000 7f76577fe700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7650080670 0x7f7650082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.460+0000 7f76577fe700 1 -- 172.21.15.164:0/1767706588 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f76700a4350 con 0x7f76780c45e0 2020-11-20T11:50:55.484 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.460+0000 7f76777fe700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7650080670 0x7f7650082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.484 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.461+0000 7f76777fe700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7650080670 0x7f7650082b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7668000f60 tx=0x7f7668009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:55.485 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.464+0000 7f76577fe700 1 -- 172.21.15.164:0/1767706588 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7670078d60 con 0x7f76780c45e0 2020-11-20T11:50:55.607 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.603+0000 7f767dfb8700 1 -- 172.21.15.164:0/1767706588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7678069b70 con 0x7f76780c45e0 2020-11-20T11:50:55.608 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.604+0000 7f76577fe700 1 -- 172.21.15.164:0/1767706588 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f767007c380 con 0x7f76780c45e0 2020-11-20T11:50:55.608 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 8 2020-11-20T11:50:55.610 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.605+0000 7f767dfb8700 1 -- 172.21.15.164:0/1767706588 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7650080670 msgr2=0x7f7650082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.610 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.605+0000 7f767dfb8700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7650080670 0x7f7650082b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7668000f60 tx=0x7f7668009040).stop 2020-11-20T11:50:55.610 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.605+0000 7f767dfb8700 1 -- 172.21.15.164:0/1767706588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f76780c45e0 msgr2=0x7f76781613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.611 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.605+0000 7f767dfb8700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f76780c45e0 0x7f76781613e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f7670006f40 tx=0x7f76780c7720).stop 2020-11-20T11:50:55.611 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.605+0000 7f767dfb8700 1 -- 172.21.15.164:0/1767706588 shutdown_connections 2020-11-20T11:50:55.611 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.605+0000 7f767dfb8700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7650080670 0x7f7650082b30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.611 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.605+0000 7f767dfb8700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f76780c45e0 0x7f76781613e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.611 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.605+0000 7f767dfb8700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76780bccf0 0x7f76780c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.612 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.605+0000 7f767dfb8700 1 --2- 172.21.15.164:0/1767706588 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76780c4200 0x7f7678163ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.612 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.605+0000 7f767dfb8700 1 -- 172.21.15.164:0/1767706588 >> 172.21.15.164:0/1767706588 conn(0x7f76780678e0 msgr2=0x7f767814c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:55.612 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.606+0000 7f767dfb8700 1 -- 172.21.15.164:0/1767706588 shutdown_connections 2020-11-20T11:50:55.612 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.606+0000 7f767dfb8700 1 -- 172.21.15.164:0/1767706588 wait complete. 2020-11-20T11:50:55.621 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:50:55.733 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.729+0000 7fd6dae79700 1 Processor -- start 2020-11-20T11:50:55.733 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.729+0000 7fd6dae79700 1 -- start start 2020-11-20T11:50:55.735 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.730+0000 7fd6dae79700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd6d40677a0 0x7fd6d4067b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.735 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.730+0000 7fd6dae79700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd6d4063e80 0x7fd6d40bb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.736 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.730+0000 7fd6dae79700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d40bc600 con 0x7fd6d414e140 2020-11-20T11:50:55.736 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.730+0000 7fd6dae79700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d40bc8a0 con 0x7fd6d40677a0 2020-11-20T11:50:55.736 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.730+0000 7fd6dae79700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d40bcb40 con 0x7fd6d4063e80 2020-11-20T11:50:55.736 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.730+0000 7fd6d3fff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fd6d414e140 0x7fd6d4063770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55802/0 (socket says 172.21.15.164:55802) 2020-11-20T11:50:55.736 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.730+0000 7fd6d3fff700 1 -- 172.21.15.164:0/2322549780 learned_addr learned my addr 172.21.15.164:0/2322549780 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:55.737 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.730+0000 7fd6d9416700 1 --2- 172.21.15.164:0/2322549780 >> v2:172.21.15.188:3300/0 conn(0x7fd6d4063e80 0x7fd6d40bb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.737 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d8c15700 1 --2- 172.21.15.164:0/2322549780 >> v2:172.21.15.36:3300/0 conn(0x7fd6d40677a0 0x7fd6d4067b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.737 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d37fe700 1 -- 172.21.15.164:0/2322549780 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553528565 0 0) 0x7fd6d40bc600 con 0x7fd6d414e140 2020-11-20T11:50:55.738 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d37fe700 1 -- 172.21.15.164:0/2322549780 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b8003280 con 0x7fd6d414e140 2020-11-20T11:50:55.738 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d8c15700 1 -- 172.21.15.164:0/2322549780 >> v2:172.21.15.188:3300/0 conn(0x7fd6d4063e80 msgr2=0x7fd6d40bb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:55.738 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d8c15700 1 --2- 172.21.15.164:0/2322549780 >> v2:172.21.15.188:3300/0 conn(0x7fd6d4063e80 0x7fd6d40bb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.738 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d8c15700 1 -- 172.21.15.164:0/2322549780 >> v1:172.21.15.164:6789/0 conn(0x7fd6d414e140 legacy=0x7fd6d4063770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.738 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d8c15700 1 -- 172.21.15.164:0/2322549780 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d40bcde0 con 0x7fd6d40677a0 2020-11-20T11:50:55.739 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d8c15700 1 --2- 172.21.15.164:0/2322549780 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6d40677a0 0x7fd6d4067b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd6d40ba600 tx=0x7fd6c8006e30).ready entity=mon.0 client_cookie=124b5925586649c2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:55.739 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d37fe700 1 -- 172.21.15.164:0/2322549780 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80095c0 con 0x7fd6d40677a0 2020-11-20T11:50:55.739 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d37fe700 1 -- 172.21.15.164:0/2322549780 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c8000e90 con 0x7fd6d40677a0 2020-11-20T11:50:55.739 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.731+0000 7fd6d37fe700 1 -- 172.21.15.164:0/2322549780 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8009930 con 0x7fd6d40677a0 2020-11-20T11:50:55.742 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.732+0000 7fd6dae79700 1 -- 172.21.15.164:0/2322549780 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6d40677a0 msgr2=0x7fd6d4067b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.732+0000 7fd6dae79700 1 --2- 172.21.15.164:0/2322549780 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6d40677a0 0x7fd6d4067b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd6d40ba600 tx=0x7fd6c8006e30).stop 2020-11-20T11:50:55.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.732+0000 7fd6dae79700 1 -- 172.21.15.164:0/2322549780 shutdown_connections 2020-11-20T11:50:55.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.732+0000 7fd6dae79700 1 --2- 172.21.15.164:0/2322549780 >> v2:172.21.15.188:3300/0 conn(0x7fd6d4063e80 0x7fd6d40bb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.732+0000 7fd6dae79700 1 --2- 172.21.15.164:0/2322549780 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6d40677a0 0x7fd6d4067b80 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0x7fd6d40ba600 tx=0x7fd6c8006e30).stop 2020-11-20T11:50:55.743 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.732+0000 7fd6dae79700 1 -- 172.21.15.164:0/2322549780 >> 172.21.15.164:0/2322549780 conn(0x7fd6d4060c80 msgr2=0x7fd6d40c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:55.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.732+0000 7fd6dae79700 1 -- 172.21.15.164:0/2322549780 shutdown_connections 2020-11-20T11:50:55.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.732+0000 7fd6dae79700 1 -- 172.21.15.164:0/2322549780 wait complete. 2020-11-20T11:50:55.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.733+0000 7fd6dae79700 1 Processor -- start 2020-11-20T11:50:55.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.734+0000 7fd6dae79700 1 -- start start 2020-11-20T11:50:55.744 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.734+0000 7fd6dae79700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6d4063e80 0x7fd6d41646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.745 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.734+0000 7fd6dae79700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6d414e140 0x7fd6d40c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.745 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.734+0000 7fd6dae79700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6d4130dc0 0x7fd6d413fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.745 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.734+0000 7fd6dae79700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4164bc0 con 0x7fd6d4063e80 2020-11-20T11:50:55.745 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.734+0000 7fd6dae79700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40c1d20 con 0x7fd6d414e140 2020-11-20T11:50:55.746 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.734+0000 7fd6dae79700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40c1fc0 con 0x7fd6d4130dc0 2020-11-20T11:50:55.746 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.734+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6d414e140 0x7fd6d40c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.746 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.734+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6d414e140 0x7fd6d40c14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46066/0 (socket says 172.21.15.164:46066) 2020-11-20T11:50:55.746 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.734+0000 7fd6d3fff700 1 -- 172.21.15.164:0/3214404446 learned_addr learned my addr 172.21.15.164:0/3214404446 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:55.747 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d9416700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6d4130dc0 0x7fd6d413fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.747 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d3fff700 1 -- 172.21.15.164:0/3214404446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6d4130dc0 msgr2=0x7fd6d413fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.747 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d8c15700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6d4063e80 0x7fd6d41646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.747 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d3fff700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6d4130dc0 0x7fd6d413fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.748 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d3fff700 1 -- 172.21.15.164:0/3214404446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6d4063e80 msgr2=0x7fd6d41646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.748 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d3fff700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6d4063e80 0x7fd6d41646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.748 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d3fff700 1 -- 172.21.15.164:0/3214404446 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d41608c0 con 0x7fd6d414e140 2020-11-20T11:50:55.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d9416700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6d4130dc0 0x7fd6d413fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:55.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d3fff700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6d414e140 0x7fd6d40c14a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fd6c000c710 tx=0x7fd6c0007ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:55.749 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d0ff9700 1 -- 172.21.15.164:0/3214404446 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0007320 con 0x7fd6d414e140 2020-11-20T11:50:55.750 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d0ff9700 1 -- 172.21.15.164:0/3214404446 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c0007480 con 0x7fd6d414e140 2020-11-20T11:50:55.750 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6d0ff9700 1 -- 172.21.15.164:0/3214404446 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0005840 con 0x7fd6d414e140 2020-11-20T11:50:55.750 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6dae79700 1 -- 172.21.15.164:0/3214404446 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4160b60 con 0x7fd6d414e140 2020-11-20T11:50:55.751 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.735+0000 7fd6dae79700 1 -- 172.21.15.164:0/3214404446 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d41610a0 con 0x7fd6d414e140 2020-11-20T11:50:55.751 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.736+0000 7fd6dae79700 1 -- 172.21.15.164:0/3214404446 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d4147a20 con 0x7fd6d414e140 2020-11-20T11:50:55.751 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.737+0000 7fd6d0ff9700 1 -- 172.21.15.164:0/3214404446 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd6c0010030 con 0x7fd6d414e140 2020-11-20T11:50:55.751 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.737+0000 7fd6d0ff9700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd6ac0806a0 0x7fd6ac082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:55.752 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.737+0000 7fd6d0ff9700 1 -- 172.21.15.164:0/3214404446 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd6c00a2790 con 0x7fd6d414e140 2020-11-20T11:50:55.752 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.737+0000 7fd6d8c15700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd6ac0806a0 0x7fd6ac082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:55.752 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.737+0000 7fd6d8c15700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd6ac0806a0 0x7fd6ac082b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd6d4063390 tx=0x7fd6c8015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:55.753 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.740+0000 7fd6d0ff9700 1 -- 172.21.15.164:0/3214404446 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd6c00771a0 con 0x7fd6d414e140 2020-11-20T11:50:55.886 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.883+0000 7fd6dae79700 1 -- 172.21.15.164:0/3214404446 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6d4069b70 con 0x7fd6d414e140 2020-11-20T11:50:55.887 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.883+0000 7fd6d0ff9700 1 -- 172.21.15.164:0/3214404446 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd6c007a7c0 con 0x7fd6d414e140 2020-11-20T11:50:55.887 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 8 2020-11-20T11:50:55.888 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 -- 172.21.15.164:0/3214404446 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd6ac0806a0 msgr2=0x7fd6ac082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd6ac0806a0 0x7fd6ac082b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd6d4063390 tx=0x7fd6c8015000).stop 2020-11-20T11:50:55.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 -- 172.21.15.164:0/3214404446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6d414e140 msgr2=0x7fd6d40c14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:55.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6d414e140 0x7fd6d40c14a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fd6c000c710 tx=0x7fd6c0007ae0).stop 2020-11-20T11:50:55.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 -- 172.21.15.164:0/3214404446 shutdown_connections 2020-11-20T11:50:55.889 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd6ac0806a0 0x7fd6ac082b60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6d4130dc0 0x7fd6d413fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6d4063e80 0x7fd6d41646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.890 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 --2- 172.21.15.164:0/3214404446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6d414e140 0x7fd6d40c14a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:55.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 -- 172.21.15.164:0/3214404446 >> 172.21.15.164:0/3214404446 conn(0x7fd6d4060c80 msgr2=0x7fd6d4063770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:55.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 -- 172.21.15.164:0/3214404446 shutdown_connections 2020-11-20T11:50:55.891 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:55.885+0000 7fd6dae79700 1 -- 172.21.15.164:0/3214404446 wait complete. 2020-11-20T11:50:55.899 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:50:56.011 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.007+0000 7f61cdd7d700 1 Processor -- start 2020-11-20T11:50:56.011 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.008+0000 7f61cdd7d700 1 -- start start 2020-11-20T11:50:56.014 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.008+0000 7f61cdd7d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f61c80bccf0 0x7f61c80c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.014 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.008+0000 7f61cdd7d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c81555a0 con 0x7f61c80bf680 2020-11-20T11:50:56.014 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.008+0000 7f61cdd7d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c81517d0 con 0x7f61c80c4470 2020-11-20T11:50:56.014 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.008+0000 7f61cdd7d700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c8151a70 con 0x7f61c80bccf0 2020-11-20T11:50:56.014 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c77fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f61c80c4470 0x7f61c80c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55812/0 (socket says 172.21.15.164:55812) 2020-11-20T11:50:56.015 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c77fe700 1 -- 172.21.15.164:0/3366952952 learned_addr learned my addr 172.21.15.164:0/3366952952 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T11:50:56.015 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c6ffd700 1 --2- 172.21.15.164:0/3366952952 >> v2:172.21.15.164:3300/0 conn(0x7f61c80bccf0 0x7f61c80c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.015 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c67fc700 1 -- 172.21.15.164:0/3366952952 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082428153 0 0) 0x7f61c81517d0 con 0x7f61c80c4470 2020-11-20T11:50:56.015 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c67fc700 1 -- 172.21.15.164:0/3366952952 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b4003280 con 0x7f61c80c4470 2020-11-20T11:50:56.016 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c6ffd700 1 -- 172.21.15.164:0/3366952952 >> v1:172.21.15.164:6789/0 conn(0x7f61c80c4470 legacy=0x7f61c80c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.016 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c6ffd700 1 -- 172.21.15.164:0/3366952952 >> v1:172.21.15.36:6789/0 conn(0x7f61c80bf680 legacy=0x7f61c81504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.016 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c6ffd700 1 -- 172.21.15.164:0/3366952952 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8151d10 con 0x7f61c80bccf0 2020-11-20T11:50:56.016 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c6ffd700 1 --2- 172.21.15.164:0/3366952952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 0x7f61c80c4850 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f61bc006fd0 tx=0x7f61bc006e30).ready entity=mon.1 client_cookie=9457f61be4601d8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:56.016 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c67fc700 1 -- 172.21.15.164:0/3366952952 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc009870 con 0x7f61c80bccf0 2020-11-20T11:50:56.017 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c67fc700 1 -- 172.21.15.164:0/3366952952 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc000e90 con 0x7f61c80bccf0 2020-11-20T11:50:56.017 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.009+0000 7f61c67fc700 1 -- 172.21.15.164:0/3366952952 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc009be0 con 0x7f61c80bccf0 2020-11-20T11:50:56.017 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.010+0000 7f61cdd7d700 1 -- 172.21.15.164:0/3366952952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 msgr2=0x7f61c80c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.017 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.010+0000 7f61cdd7d700 1 --2- 172.21.15.164:0/3366952952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 0x7f61c80c4850 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f61bc006fd0 tx=0x7f61bc006e30).stop 2020-11-20T11:50:56.017 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.010+0000 7f61cdd7d700 1 -- 172.21.15.164:0/3366952952 shutdown_connections 2020-11-20T11:50:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.010+0000 7f61cdd7d700 1 --2- 172.21.15.164:0/3366952952 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 0x7f61c80c4850 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.010+0000 7f61cdd7d700 1 -- 172.21.15.164:0/3366952952 >> 172.21.15.164:0/3366952952 conn(0x7f61c80683b0 msgr2=0x7f61c8061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.010+0000 7f61cdd7d700 1 -- 172.21.15.164:0/3366952952 shutdown_connections 2020-11-20T11:50:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.010+0000 7f61cdd7d700 1 -- 172.21.15.164:0/3366952952 wait complete. 2020-11-20T11:50:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.011+0000 7f61cdd7d700 1 Processor -- start 2020-11-20T11:50:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.011+0000 7f61cdd7d700 1 -- start start 2020-11-20T11:50:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61cdd7d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 0x7f61c80c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61cdd7d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61c80bf680 0x7f61c814bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61cdd7d700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61c80c4470 0x7f61c8160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61cdd7d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8163b20 con 0x7f61c80bf680 2020-11-20T11:50:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61cdd7d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8112d90 con 0x7f61c80bccf0 2020-11-20T11:50:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61cdd7d700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8113030 con 0x7f61c80c4470 2020-11-20T11:50:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c77fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 0x7f61c80c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.023 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c77fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 0x7f61c80c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46078/0 (socket says 172.21.15.164:46078) 2020-11-20T11:50:56.023 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c77fe700 1 -- 172.21.15.164:0/46800308 learned_addr learned my addr 172.21.15.164:0/46800308 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:56.023 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c6ffd700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61c80bf680 0x7f61c814bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.023 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c7fff700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61c80c4470 0x7f61c8160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.023 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c77fe700 1 -- 172.21.15.164:0/46800308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61c80c4470 msgr2=0x7f61c8160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.024 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c77fe700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61c80c4470 0x7f61c8160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.024 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c77fe700 1 -- 172.21.15.164:0/46800308 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61c80bf680 msgr2=0x7f61c814bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.024 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c77fe700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61c80bf680 0x7f61c814bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.024 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c77fe700 1 -- 172.21.15.164:0/46800308 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8163d50 con 0x7f61c80bccf0 2020-11-20T11:50:56.024 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c7fff700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61c80c4470 0x7f61c8160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:56.025 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61c77fe700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 0x7f61c80c71c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f61b800c710 tx=0x7f61b8007b10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:56.025 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61a77fe700 1 -- 172.21.15.164:0/46800308 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b80072e0 con 0x7f61c80bccf0 2020-11-20T11:50:56.025 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61a77fe700 1 -- 172.21.15.164:0/46800308 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8007440 con 0x7f61c80bccf0 2020-11-20T11:50:56.025 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61cdd7d700 1 -- 172.21.15.164:0/46800308 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c8163ff0 con 0x7f61c80bccf0 2020-11-20T11:50:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61a77fe700 1 -- 172.21.15.164:0/46800308 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8005840 con 0x7f61c80bccf0 2020-11-20T11:50:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.012+0000 7f61cdd7d700 1 -- 172.21.15.164:0/46800308 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c814c130 con 0x7f61c80bccf0 2020-11-20T11:50:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.013+0000 7f61cdd7d700 1 -- 172.21.15.164:0/46800308 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c8164450 con 0x7f61c80bccf0 2020-11-20T11:50:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.014+0000 7f61a77fe700 1 -- 172.21.15.164:0/46800308 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f61b8010070 con 0x7f61c80bccf0 2020-11-20T11:50:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.015+0000 7f61a77fe700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f61a0080670 0x7f61a0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.027 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.015+0000 7f61a77fe700 1 -- 172.21.15.164:0/46800308 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f61b80a1fd0 con 0x7f61c80bccf0 2020-11-20T11:50:56.027 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.015+0000 7f61c6ffd700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f61a0080670 0x7f61a0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.027 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.015+0000 7f61c6ffd700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f61a0080670 0x7f61a0082b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f61bc006fd0 tx=0x7f61bc015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:56.028 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.018+0000 7f61a77fe700 1 -- 172.21.15.164:0/46800308 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f61b8076a70 con 0x7f61c80bccf0 2020-11-20T11:50:56.161 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.157+0000 7f61cdd7d700 1 -- 172.21.15.164:0/46800308 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61c8069b70 con 0x7f61c80bccf0 2020-11-20T11:50:56.161 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.157+0000 7f61a77fe700 1 -- 172.21.15.164:0/46800308 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7f61b807a090 con 0x7f61c80bccf0 2020-11-20T11:50:56.161 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 8 2020-11-20T11:50:56.163 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 -- 172.21.15.164:0/46800308 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f61a0080670 msgr2=0x7f61a0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.163 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f61a0080670 0x7f61a0082b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f61bc006fd0 tx=0x7f61bc015000).stop 2020-11-20T11:50:56.163 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 -- 172.21.15.164:0/46800308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 msgr2=0x7f61c80c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.163 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 0x7f61c80c71c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f61b800c710 tx=0x7f61b8007b10).stop 2020-11-20T11:50:56.164 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 -- 172.21.15.164:0/46800308 shutdown_connections 2020-11-20T11:50:56.164 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f61a0080670 0x7f61a0082b30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.164 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61c80bccf0 0x7f61c80c71c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.164 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61c80c4470 0x7f61c8160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.164 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 --2- 172.21.15.164:0/46800308 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61c80bf680 0x7f61c814bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.165 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 -- 172.21.15.164:0/46800308 >> 172.21.15.164:0/46800308 conn(0x7f61c80683b0 msgr2=0x7f61c80c21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:56.165 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 -- 172.21.15.164:0/46800308 shutdown_connections 2020-11-20T11:50:56.165 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.159+0000 7f61cdd7d700 1 -- 172.21.15.164:0/46800308 wait complete. 2020-11-20T11:50:56.174 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-11-20T11:50:56.174 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:50:56.287 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.283+0000 7f3b02db7700 1 Processor -- start 2020-11-20T11:50:56.287 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.283+0000 7f3b02db7700 1 -- start start 2020-11-20T11:50:56.289 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b02db7700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3afc0c20f0 0x7f3afc0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.290 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b02db7700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3afc155330 0x7f3afc062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.290 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b02db7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3afc0bc410 con 0x7f3afc064b60 2020-11-20T11:50:56.290 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b02db7700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc066a70 con 0x7f3afc0c20f0 2020-11-20T11:50:56.290 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b02db7700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc066d10 con 0x7f3afc155330 2020-11-20T11:50:56.290 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b00b53700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3afc0c20f0 0x7f3afc0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.291 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b00b53700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3afc0c20f0 0x7f3afc0c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46086/0 (socket says 172.21.15.164:46086) 2020-11-20T11:50:56.291 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b00b53700 1 -- 172.21.15.164:0/2959863219 learned_addr learned my addr 172.21.15.164:0/2959863219 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:56.291 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3afbfff700 1 --2- 172.21.15.164:0/2959863219 >> v2:172.21.15.188:3300/0 conn(0x7f3afc155330 0x7f3afc062bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.291 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b00b53700 1 -- 172.21.15.164:0/2959863219 >> v2:172.21.15.188:3300/0 conn(0x7f3afc155330 msgr2=0x7f3afc062bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:50:56.291 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b00b53700 1 --2- 172.21.15.164:0/2959863219 >> v2:172.21.15.188:3300/0 conn(0x7f3afc155330 0x7f3afc062bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.292 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b00b53700 1 -- 172.21.15.164:0/2959863219 >> v1:172.21.15.36:6789/0 conn(0x7f3afc064b60 legacy=0x7f3afc150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.292 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3b00b53700 1 -- 172.21.15.164:0/2959863219 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc1546b0 con 0x7f3afc0c20f0 2020-11-20T11:50:56.292 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.284+0000 7f3afbfff700 1 --2- 172.21.15.164:0/2959863219 >> v2:172.21.15.188:3300/0 conn(0x7f3afc155330 0x7f3afc062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:50:56.292 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3b00b53700 1 --2- 172.21.15.164:0/2959863219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 0x7f3afc0c24d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f3afc069120 tx=0x7f3af0006ef0).ready entity=mon.1 client_cookie=93447c981d902e8a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:56.292 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3afb7fe700 1 -- 172.21.15.164:0/2959863219 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000b860 con 0x7f3afc0c20f0 2020-11-20T11:50:56.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3afb7fe700 1 -- 172.21.15.164:0/2959863219 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af0000e90 con 0x7f3afc0c20f0 2020-11-20T11:50:56.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3afb7fe700 1 -- 172.21.15.164:0/2959863219 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000bbd0 con 0x7f3afc0c20f0 2020-11-20T11:50:56.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3b02db7700 1 -- 172.21.15.164:0/2959863219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 msgr2=0x7f3afc0c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3b02db7700 1 --2- 172.21.15.164:0/2959863219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 0x7f3afc0c24d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f3afc069120 tx=0x7f3af0006ef0).stop 2020-11-20T11:50:56.293 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3b02db7700 1 -- 172.21.15.164:0/2959863219 shutdown_connections 2020-11-20T11:50:56.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3b02db7700 1 --2- 172.21.15.164:0/2959863219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 0x7f3afc0c24d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3b02db7700 1 --2- 172.21.15.164:0/2959863219 >> v2:172.21.15.188:3300/0 conn(0x7f3afc155330 0x7f3afc062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3b02db7700 1 -- 172.21.15.164:0/2959863219 >> 172.21.15.164:0/2959863219 conn(0x7f3afc0601b0 msgr2=0x7f3afc0605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:56.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3b02db7700 1 -- 172.21.15.164:0/2959863219 shutdown_connections 2020-11-20T11:50:56.294 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.285+0000 7f3b02db7700 1 -- 172.21.15.164:0/2959863219 wait complete. 2020-11-20T11:50:56.297 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.286+0000 7f3b02db7700 1 Processor -- start 2020-11-20T11:50:56.297 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.287+0000 7f3b02db7700 1 -- start start 2020-11-20T11:50:56.298 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.287+0000 7f3b02db7700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3afc064b60 0x7f3afc0bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.298 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.287+0000 7f3b02db7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 0x7f3afc160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.298 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.287+0000 7f3b02db7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3afc155330 0x7f3afc14d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.298 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.287+0000 7f3b02db7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0bff10 con 0x7f3afc155330 2020-11-20T11:50:56.298 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.287+0000 7f3b02db7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0bf590 con 0x7f3afc0c20f0 2020-11-20T11:50:56.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.287+0000 7f3b02db7700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1614b0 con 0x7f3afc064b60 2020-11-20T11:50:56.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.287+0000 7f3afbfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 0x7f3afc160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.287+0000 7f3afbfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 0x7f3afc160fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46094/0 (socket says 172.21.15.164:46094) 2020-11-20T11:50:56.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.287+0000 7f3afbfff700 1 -- 172.21.15.164:0/1577353694 learned_addr learned my addr 172.21.15.164:0/1577353694 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T11:50:56.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3b00b53700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3afc064b60 0x7f3afc0bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3afbfff700 1 -- 172.21.15.164:0/1577353694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3afc064b60 msgr2=0x7f3afc0bf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3afbfff700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3afc064b60 0x7f3afc0bf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3afbfff700 1 -- 172.21.15.164:0/1577353694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3afc155330 msgr2=0x7f3afc14d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3b01354700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3afc155330 0x7f3afc14d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.300 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3afbfff700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3afc155330 0x7f3afc14d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3afbfff700 1 -- 172.21.15.164:0/1577353694 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc0c0140 con 0x7f3afc0c20f0 2020-11-20T11:50:56.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3afbfff700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 0x7f3afc160fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f3ae800cb20 tx=0x7f3ae8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:56.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3af8ff9700 1 -- 172.21.15.164:0/1577353694 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80077d0 con 0x7f3afc0c20f0 2020-11-20T11:50:56.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3af8ff9700 1 -- 172.21.15.164:0/1577353694 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8007930 con 0x7f3afc0c20f0 2020-11-20T11:50:56.301 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3b02db7700 1 -- 172.21.15.164:0/1577353694 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc0c03e0 con 0x7f3afc0c20f0 2020-11-20T11:50:56.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3af8ff9700 1 -- 172.21.15.164:0/1577353694 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8007cb0 con 0x7f3afc0c20f0 2020-11-20T11:50:56.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.288+0000 7f3b02db7700 1 -- 172.21.15.164:0/1577353694 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc0c0920 con 0x7f3afc0c20f0 2020-11-20T11:50:56.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.289+0000 7f3b02db7700 1 -- 172.21.15.164:0/1577353694 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc0bf890 con 0x7f3afc0c20f0 2020-11-20T11:50:56.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.290+0000 7f3af8ff9700 1 -- 172.21.15.164:0/1577353694 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3ae8011620 con 0x7f3afc0c20f0 2020-11-20T11:50:56.302 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.290+0000 7f3af8ff9700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3ad4080670 0x7f3ad4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:50:56.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.290+0000 7f3af8ff9700 1 -- 172.21.15.164:0/1577353694 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3ae80a3710 con 0x7f3afc0c20f0 2020-11-20T11:50:56.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.290+0000 7f3b00b53700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3ad4080670 0x7f3ad4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:50:56.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.290+0000 7f3b00b53700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3ad4080670 0x7f3ad4082b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3af0006f30 tx=0x7f3af0016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:50:56.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.293+0000 7f3af8ff9700 1 -- 172.21.15.164:0/1577353694 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3ae8078120 con 0x7f3afc0c20f0 2020-11-20T11:50:56.483 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.479+0000 7f3b02db7700 1 -- 172.21.15.164:0/1577353694 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3afc0c24d0 con 0x7f3afc0c20f0 2020-11-20T11:50:56.637 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.480+0000 7f3af8ff9700 1 -- 172.21.15.164:0/1577353694 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2489 (secure 0 0 0) 0x7f3ae807b740 con 0x7f3afc0c20f0 2020-11-20T11:50:56.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 -- 172.21.15.164:0/1577353694 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3ad4080670 msgr2=0x7f3ad4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3ad4080670 0x7f3ad4082b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3af0006f30 tx=0x7f3af0016000).stop 2020-11-20T11:50:56.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 -- 172.21.15.164:0/1577353694 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 msgr2=0x7f3afc160fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:50:56.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 0x7f3afc160fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f3ae800cb20 tx=0x7f3ae8008040).stop 2020-11-20T11:50:56.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 -- 172.21.15.164:0/1577353694 shutdown_connections 2020-11-20T11:50:56.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f3ad4080670 0x7f3ad4082b30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3afc155330 0x7f3afc14d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3afc064b60 0x7f3afc0bf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 --2- 172.21.15.164:0/1577353694 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3afc0c20f0 0x7f3afc160fc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:50:56.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 -- 172.21.15.164:0/1577353694 >> 172.21.15.164:0/1577353694 conn(0x7f3afc0601b0 msgr2=0x7f3afc062d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:50:56.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 -- 172.21.15.164:0/1577353694 shutdown_connections 2020-11-20T11:50:56.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T11:50:56.481+0000 7f3b02db7700 1 -- 172.21.15.164:0/1577353694 wait complete. 2020-11-20T11:50:56.641 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 7 2020-11-20T11:50:56.641 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T11:50:56.641 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4309,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1360026757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1360026757},{"type":"v1","addr":"172.21.15.164:6835","nonce":1360026757}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/3921177334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3921177334},{"type":"v1","addr":"172.21.15.188:6833","nonce":3921177334}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:50:39.612795+0000","modified":"2020-11-20T11:50:41.621570+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6833/1888702035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":1888702035},{"type":"v1","addr":"172.21.15.36:6833","nonce":1888702035}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:50:56.943 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T11:50:39.612795+0000', 'modified': '2020-11-20T11:50:41.621570+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4321}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4321': {'gid': 4321, 'name': 'b', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6833/1888702035', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6832', 'nonce': 1888702035}, {'type': 'v1', 'addr': '172.21.15.36:6833', 'nonce': 1888702035}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T11:50:56.944 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T11:50:56.944 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-11-20T11:50:57.092 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","whoami":0,"id":4321,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":17.464573462000001,"mdsmap_epoch":7,"osdmap_epoch":28,"osdmap_epoch_barrier":28,"uptime":23.829358444} 2020-11-20T11:50:57.092 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "8d9b76f1-9267-4076-877e-b8d77372c9f3", "fs_name": "cephfs", "id": 4321, "mdsmap_epoch": 7, "osdmap_epoch": 28, "osdmap_epoch_barrier": 28, "rank_uptime": 17.464573462, "state": "up:active", "uptime": 23.829358444, "want_state": "up:active", "whoami": 0 } 2020-11-20T11:50:57.093 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-11-20T11:50:57.093 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-11-20T11:50:57.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:50:57.094 INFO:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:50:57.109 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2020-11-20T11:50:57.110 INFO:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2020-11-20T11:50:57.206 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-11-20T11:50:57.207 INFO:teuthology.orchestra.run.smithi164:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-11-20T11:50:57.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:50:57.237 INFO:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2020-11-20T11:50:57.292 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-11-20T11:50:57.293 INFO:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --id 0 /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:50:57.335 INFO:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2020-11-20T11:50:57.359 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-11-20T11:50:57.359 INFO:teuthology.orchestra.run.smithi164:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-11-20T11:50:57.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:2020-11-20T11:50:57.420+0000 7fb11b879240 -1 init, newargv = 0x55fe6d6e4120 newargc=15 2020-11-20T11:50:57.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:ceph-fuse[28779]: starting ceph client 2020-11-20T11:50:57.425 INFO:teuthology.orchestra.run.smithi164.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-11-20T11:50:57.426 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-11-20T11:50:57.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:50:57.426 INFO:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2020-11-20T11:50:57.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:ceph-fuse[28779]: starting fuse 2020-11-20T11:50:57.443 INFO:teuthology.orchestra.run.smithi164.stdout:47 2020-11-20T11:50:57.443 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-11-20T11:50:57.443 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-11-20T11:50:57.444 INFO:teuthology.orchestra.run.smithi164:> import glob 2020-11-20T11:50:57.444 INFO:teuthology.orchestra.run.smithi164:> import re 2020-11-20T11:50:57.444 INFO:teuthology.orchestra.run.smithi164:> import os 2020-11-20T11:50:57.445 INFO:teuthology.orchestra.run.smithi164:> import subprocess 2020-11-20T11:50:57.445 INFO:teuthology.orchestra.run.smithi164:> 2020-11-20T11:50:57.445 INFO:teuthology.orchestra.run.smithi164:> def _find_admin_socket(client_name): 2020-11-20T11:50:57.446 INFO:teuthology.orchestra.run.smithi164:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-11-20T11:50:57.447 INFO:teuthology.orchestra.run.smithi164:> files = glob.glob(asok_path) 2020-11-20T11:50:57.447 INFO:teuthology.orchestra.run.smithi164:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2020-11-20T11:50:57.448 INFO:teuthology.orchestra.run.smithi164:> 2020-11-20T11:50:57.448 INFO:teuthology.orchestra.run.smithi164:> # Given a non-glob path, it better be there 2020-11-20T11:50:57.448 INFO:teuthology.orchestra.run.smithi164:> if "*" not in asok_path: 2020-11-20T11:50:57.449 INFO:teuthology.orchestra.run.smithi164:> assert(len(files) == 1) 2020-11-20T11:50:57.449 INFO:teuthology.orchestra.run.smithi164:> return files[0] 2020-11-20T11:50:57.449 INFO:teuthology.orchestra.run.smithi164:> 2020-11-20T11:50:57.450 INFO:teuthology.orchestra.run.smithi164:> for f in files: 2020-11-20T11:50:57.450 INFO:teuthology.orchestra.run.smithi164:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-11-20T11:50:57.450 INFO:teuthology.orchestra.run.smithi164:> if os.path.exists("/proc/{0}".format(pid)): 2020-11-20T11:50:57.451 INFO:teuthology.orchestra.run.smithi164:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2020-11-20T11:50:57.451 INFO:teuthology.orchestra.run.smithi164:> contents = proc_f.read() 2020-11-20T11:50:57.451 INFO:teuthology.orchestra.run.smithi164:> if mountpoint in contents: 2020-11-20T11:50:57.452 INFO:teuthology.orchestra.run.smithi164:> return f 2020-11-20T11:50:57.452 INFO:teuthology.orchestra.run.smithi164:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-11-20T11:50:57.452 INFO:teuthology.orchestra.run.smithi164:> 2020-11-20T11:50:57.453 INFO:teuthology.orchestra.run.smithi164:> print(_find_admin_socket("client.0")) 2020-11-20T11:50:57.453 INFO:teuthology.orchestra.run.smithi164:> ' 2020-11-20T11:50:57.562 INFO:teuthology.orchestra.run.smithi164.stdout:/var/run/ceph/ceph-client.0.28779.asok 2020-11-20T11:50:57.744 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.28779.asok 2020-11-20T11:50:57.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:50:57.745 INFO:teuthology.orchestra.run.smithi164:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.28779.asok status 2020-11-20T11:50:57.912 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T11:50:57.913 INFO:teuthology.orchestra.run.smithi164.stdout: "metadata": { 2020-11-20T11:50:57.913 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_sha1": "b86e691bf191566922a8f08e2a5abf64fde8cfcb", 2020-11-20T11:50:57.914 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_version": "ceph version 16.0.0-7397-gb86e691b (b86e691bf191566922a8f08e2a5abf64fde8cfcb) pacific (dev)", 2020-11-20T11:50:57.914 INFO:teuthology.orchestra.run.smithi164.stdout: "entity_id": "0", 2020-11-20T11:50:57.914 INFO:teuthology.orchestra.run.smithi164.stdout: "hostname": "smithi164", 2020-11-20T11:50:57.914 INFO:teuthology.orchestra.run.smithi164.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-11-20T11:50:57.914 INFO:teuthology.orchestra.run.smithi164.stdout: "pid": "28779", 2020-11-20T11:50:57.915 INFO:teuthology.orchestra.run.smithi164.stdout: "root": "/" 2020-11-20T11:50:57.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2020-11-20T11:50:57.915 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_count": 0, 2020-11-20T11:50:57.915 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_pinned_count": 0, 2020-11-20T11:50:57.916 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4690, 2020-11-20T11:50:57.916 INFO:teuthology.orchestra.run.smithi164.stdout: "inst": { 2020-11-20T11:50:57.916 INFO:teuthology.orchestra.run.smithi164.stdout: "name": { 2020-11-20T11:50:57.916 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "client", 2020-11-20T11:50:57.917 INFO:teuthology.orchestra.run.smithi164.stdout: "num": 4690 2020-11-20T11:50:57.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2020-11-20T11:50:57.917 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2020-11-20T11:50:57.918 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2020-11-20T11:50:57.918 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "192.168.0.1:0", 2020-11-20T11:50:57.918 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 3817497391 2020-11-20T11:50:57.919 INFO:teuthology.orchestra.run.smithi164.stdout: } 2020-11-20T11:50:57.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2020-11-20T11:50:57.919 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2020-11-20T11:50:57.919 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2020-11-20T11:50:57.920 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "192.168.0.1:0", 2020-11-20T11:50:57.920 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 3817497391 2020-11-20T11:50:57.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2020-11-20T11:50:57.920 INFO:teuthology.orchestra.run.smithi164.stdout: "inst_str": "client.4690 192.168.0.1:0/3817497391", 2020-11-20T11:50:57.921 INFO:teuthology.orchestra.run.smithi164.stdout: "addr_str": "192.168.0.1:0/3817497391", 2020-11-20T11:50:57.921 INFO:teuthology.orchestra.run.smithi164.stdout: "inode_count": 1, 2020-11-20T11:50:57.921 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_epoch": 7, 2020-11-20T11:50:57.921 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch": 28, 2020-11-20T11:50:57.922 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch_barrier": 0, 2020-11-20T11:50:57.922 INFO:teuthology.orchestra.run.smithi164.stdout: "blocklisted": false, 2020-11-20T11:50:57.922 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs" 2020-11-20T11:50:57.922 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T11:50:57.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:50:57.924 INFO:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-11-20T11:50:57.925 INFO:teuthology.orchestra.run.smithi164:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:50:57.947 INFO:teuthology.orchestra.run.smithi164.stdout:fuseblk 2020-11-20T11:50:57.948 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-11-20T11:50:57.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:50:57.949 INFO:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:50:58.024 INFO:teuthology.run_tasks:Running task workunit... 2020-11-20T11:50:58.036 INFO:tasks.workunit:Pulling workunits from ref b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:50:58.037 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-11-20T11:50:58.038 INFO:tasks.workunit:timeout=3h 2020-11-20T11:50:58.038 INFO:tasks.workunit:cleanup=True 2020-11-20T11:50:58.038 INFO:teuthology.orchestra.run.smithi164:> stat -- /home/ubuntu/cephtest/mnt.0 2020-11-20T11:50:58.086 INFO:teuthology.orchestra.run.smithi164.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-11-20T11:50:58.086 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-11-20T11:50:58.086 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 2fh/47d Inode: 1 Links: 2 2020-11-20T11:50:58.087 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:50:58.087 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:fusefs_t:s0 2020-11-20T11:50:58.087 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-11-20T11:50:58.087 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2020-11-20 11:50:39.615658710 +0000 2020-11-20T11:50:58.088 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2020-11-20 11:50:58.019807568 +0000 2020-11-20T11:50:58.088 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2020-11-20T11:50:58.088 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-11-20T11:50:58.089 INFO:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-11-20T11:50:58.162 INFO:teuthology.orchestra.run.smithi164:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:50:58.264 INFO:tasks.workunit.client.0.smithi164.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-11-20T11:51:24.406 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:24.420 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:24.424 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:48.236 INFO:tasks.workunit.client.0.smithi164.stderr:Note: switching to 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'. 2020-11-20T11:51:48.237 INFO:tasks.workunit.client.0.smithi164.stderr: 2020-11-20T11:51:48.237 INFO:tasks.workunit.client.0.smithi164.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-11-20T11:51:48.237 INFO:tasks.workunit.client.0.smithi164.stderr:changes and commit them, and you can discard any commits you make in this 2020-11-20T11:51:48.237 INFO:tasks.workunit.client.0.smithi164.stderr:state without impacting any branches by switching back to a branch. 2020-11-20T11:51:48.238 INFO:tasks.workunit.client.0.smithi164.stderr: 2020-11-20T11:51:48.238 INFO:tasks.workunit.client.0.smithi164.stderr:If you want to create a new branch to retain commits you create, you may 2020-11-20T11:51:48.238 INFO:tasks.workunit.client.0.smithi164.stderr:do so (now or later) by using -c with the switch command. Example: 2020-11-20T11:51:48.238 INFO:tasks.workunit.client.0.smithi164.stderr: 2020-11-20T11:51:48.238 INFO:tasks.workunit.client.0.smithi164.stderr: git switch -c 2020-11-20T11:51:48.239 INFO:tasks.workunit.client.0.smithi164.stderr: 2020-11-20T11:51:48.239 INFO:tasks.workunit.client.0.smithi164.stderr:Or undo this operation with: 2020-11-20T11:51:48.239 INFO:tasks.workunit.client.0.smithi164.stderr: 2020-11-20T11:51:48.240 INFO:tasks.workunit.client.0.smithi164.stderr: git switch - 2020-11-20T11:51:48.240 INFO:tasks.workunit.client.0.smithi164.stderr: 2020-11-20T11:51:48.241 INFO:tasks.workunit.client.0.smithi164.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2020-11-20T11:51:48.241 INFO:tasks.workunit.client.0.smithi164.stderr: 2020-11-20T11:51:48.241 INFO:tasks.workunit.client.0.smithi164.stderr:HEAD is now at b86e691bf1 Merge PR #37174 into wip-pdonnell-testing-20201120.053228 2020-11-20T11:51:48.242 INFO:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-11-20T11:51:48.273 INFO:tasks.workunit.client.0.smithi164.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-11-20T11:51:48.275 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T11:51:48.275 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-11-20T11:51:48.979 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-11-20T11:51:49.038 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-11-20T11:51:49.076 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T11:51:49.077 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T11:51:49.078 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-11-20T11:51:49.113 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T11:51:49.115 INFO:teuthology.orchestra.run.smithi164:> set -ex 2020-11-20T11:51:49.116 INFO:teuthology.orchestra.run.smithi164:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T11:51:49.172 INFO:teuthology.orchestra.run.smithi164.stderr:+ dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T11:51:49.173 INFO:teuthology.orchestra.run.smithi164.stdout:mon/rbd_snaps_ops.shmon/osd.shmon/config.shmon/pg_autoscaler.shmon/test_mon_osdmap_prune.shmon/pool_ops.shmon/ping.pymon/crush_ops.shmon/test_mon_config_key.pymon/auth_caps.shmon/caps.shmon/test_config_key_caps.shpost-file.shtrue.shceph-helpers-root.shceph-tests/ceph-admin-commands.sherasure-code/bench.sherasure-code/encode-decode-non-regression.shrgw/test_rgw_reshard.pyrgw/test_rgw_throttle.shrgw/s3_bucket_quota.plrgw/test_rgw_gc_log.shrgw/test_rgw_obj.shrgw/s3_multipart_upload.plrgw/test_rgw_orphan_list.shrgw/s3_user_quota.plrgw/run-reshard.shrgw/run-s3tests.shcephtool/test_daemon.shcephtool/test_kvstore_tool.shcephtool/test.shsuites/cephfs_journal_tool_smoke.shsuites/iogen.shsuites/pjd.shsuites/dbench.shsuites/iozone-sync.shsuites/fsx.shsuites/fsstress.shsuites/fio.shsuites/iozone.shsuites/blogbench.shsuites/dbench-short.shsuites/bonnie.shsuites/fsync-tester.shsuites/ffsb.shlibcephfs/test.shcls/test_cls_cmpomap.shcls/test_cls_numops.shcls/test_cls_hello.shcls/test_cls_sdk.shcls/test_cls_rbd.shcls/test_cls_refcount.shcls/test_cls_2pc_queue.shcls/test_cls_lock.shcls/test_cls_journal.shcls/test_cls_log.shcls/test_cls_rgw.shosdc/stress_objectcacher.shrbd/merge_diff.shrbd/krbd_stable_pages_required.shrbd/rbd_mirror_ha.shrbd/diff_continuous.shrbd/test_librbd.shrbd/test_lock_fence.shrbd/qemu_rebuild_object_map.shrbd/qemu-iotests.shrbd/test_rbd_mirror.shrbd/krbd_udev_enumerate.shrbd/test_admin_socket.shrbd/krbd_wac.shrbd/notify_slave.shrbd/test_librbd_python.shrbd/rbd_mirror_bootstrap.shrbd/test_rbd_tasks.shrbd/rbd-ggate.shrbd/rbd_mirror_helpers.shrbd/test_rbdmap_RBDMAPFILE.shrbd/verify_pool.shrbd/cli_generic.shrbd/image_read.shrbd/rbd_mirror_fsx_compare.shrbd/read-flags.shrbd/map-unmap.shrbd/journal.shrbd/krbd_udev_netns.shrbd/huge-tickets.shrbd/qemu_dynamic_features.shrbd/simple_big.shrbd/krbd_latest_osdmap_on_map.shrbd/krbd_namespaces.shrbd/rbd_groups.shrbd/krbd_udev_symlinks.shrbd/rbd_mirror_stress.shrbd/permissions.shrbd/notify_master.shrbd/rbd_mirror_fsx_prepare.shrbd/import_export.shrbd/issue-20295.shrbd/map-snapshot-io.shrbd/concurrent.shrbd/qos.shrbd/krbd_huge_osdmap.shrbd/krbd_exclusive_option.shrbd/diff.shrbd/krbd_udev_netlink_enobufs.shrbd/rbd-nbd.shrbd/krbd_data_pool.shrbd/krbd_fallocate.shrbd/kernel.shrbd/rbd_mirror_journal.shrbd/rbd_mirror_snapshot.shkernel_untar_build.shmgr/test_localpool.shhadoop/terasort.shhadoop/repl.shhadoop/wordcount.shrestart/test-backtraces.pyfs/misc/mkpool_layout_vxattrs.shfs/misc/rstats.shfs/misc/subvolume.shfs/misc/filelock_interrupt.pyfs/misc/layout_vxattrs.shfs/misc/direct_io.pyfs/misc/filelock_deadlock.pyfs/misc/chmod.shfs/misc/multiple_rsync.shfs/misc/acl.shfs/misc/xattrs.shfs/misc/i_complete_vs_rename.shfs/misc/dirfrag.shfs/misc/trivial_sync.shfs/test_o_trunc.shfs/upgrade/volume_clientfs/test_python.shfs/multiclient_sync_read_eof.pyfs/quota/quota.shfs/snap-hierarchy.shfs/test_o_truncfs/norstats/kernel_untar_tar.shfs/snaps/snaptest-2.shfs/snaps/snaptest-xattrwb.shfs/snaps/snaptest-double-null.shfs/snaps/snaptest-0.shfs/snaps/snaptest-capwb.shfs/snaps/snaptest-git-ceph.shfs/snaps/untar_snap_rm.shfs/snaps/snaptest-intodir.shfs/snaps/snaptest-1.shfs/snaps/snaptest-dir-rename.shfs/snaps/snaptest-estale.shfs/snaps/snaptest-multiple-capsnaps.shfs/snaps/snaptest-upchildrealms.shfs/snaps/snaptest-parents.shfs/snaps/snaptest-snap-rename.shfs/snaps/snaptest-authwb.shfs/snaps/snaptest-realm-split.shfs/snaps/snap-rm-diff.shfs/snaps/snaptest-snap-rm-cmp.shfs/snaps/snaptest-hardlink.shobjectstore/test_fuse.shcephadm/test_adoption.shcephadm/test_dashboard_e2e.shcephadm/test_repos.shcephadm/create_iscsi_disks.shcephadm/test_cephadm.shcaps/mon_commands.shrest/test-restful.shrest/test_mgr_rest_api.pydirect_io/test_sync_iodirect_io/big.shdirect_io/test_short_dio_readdirect_io/misc.shdirect_io/direct_io_testrename/pri_nul.shrename/prepare.shrename/rem_nul.shrename/rem_pri.shrename/pri_rem.shrename/rem_rem.shrename/pri_pri.shrename/dir_pri_nul.shrename/dir_pri_pri.shrename/all.shrados/test_dedup_tool.shrados/test_large_omap_detection.pyrados/test_pool_access.shrados/test_rados_timeouts.shrados/stress_watch.shrados/clone.shrados/test_envlibrados_for_rocksdb.shrados/load-gen-mix.shrados/test.shrados/test_python.shrados/test_librados_build.shrados/test_hang.shrados/test_health_warnings.shrados/test_crash.shrados/load-gen-mix-small-long.shrados/test_cache_pool.shrados/test_alloc_hint.shrados/load-gen-big.shrados/load-gen-mostlyread.shrados/test_rados_tool.shrados/load-gen-mix-small.shrados/test_pool_quota.shrados/version_number_sanity.sh 2020-11-20T11:51:49.174 INFO:teuthology.orchestra.run.smithi164.stderr:9+1 records in 2020-11-20T11:51:49.174 INFO:teuthology.orchestra.run.smithi164.stderr:9+1 records out 2020-11-20T11:51:49.174 INFO:teuthology.orchestra.run.smithi164.stderr:4744 bytes (4.7 kB, 4.6 KiB) copied, 3.8119e-05 s, 124 MB/s 2020-11-20T11:51:49.174 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2020-11-20T11:51:49.176 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2020-11-20T11:51:49.176 INFO:teuthology.orchestra.run.smithi164:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b86e691bf191566922a8f08e2a5abf64fde8cfcb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2020-11-20T11:51:49.242 INFO:tasks.workunit.client.0.smithi164.stdout:getting iogen 2020-11-20T11:51:49.264 INFO:tasks.workunit.client.0.smithi164.stderr:--2020-11-20 11:51:49-- http://download.ceph.com/qa/iogen_3.1p0.tar 2020-11-20T11:51:49.265 INFO:tasks.workunit.client.0.smithi164.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2020-11-20T11:51:49.343 INFO:tasks.workunit.client.0.smithi164.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2020-11-20T11:51:49.423 INFO:tasks.workunit.client.0.smithi164.stderr:HTTP request sent, awaiting response... 200 OK 2020-11-20T11:51:49.423 INFO:tasks.workunit.client.0.smithi164.stderr:Length: 8071 (7.9K) [application/octet-stream] 2020-11-20T11:51:49.425 INFO:tasks.workunit.client.0.smithi164.stderr:Saving to: ‘iogen_3.1p0.tar’ 2020-11-20T11:51:49.428 INFO:tasks.workunit.client.0.smithi164.stderr: 2020-11-20T11:51:49.429 INFO:tasks.workunit.client.0.smithi164.stderr: 0K ....... 100% 1.07G=0s 2020-11-20T11:51:49.429 INFO:tasks.workunit.client.0.smithi164.stderr: 2020-11-20T11:51:49.429 INFO:tasks.workunit.client.0.smithi164.stderr:2020-11-20 11:51:49 (1.07 GB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2020-11-20T11:51:49.430 INFO:tasks.workunit.client.0.smithi164.stderr: 2020-11-20T11:51:49.446 INFO:tasks.workunit.client.0.smithi164.stdout:iogen_3.1p0 2020-11-20T11:51:49.448 INFO:tasks.workunit.client.0.smithi164.stdout:iogen_3.1p0/src 2020-11-20T11:51:49.449 INFO:tasks.workunit.client.0.smithi164.stdout:iogen_3.1p0/src/iogen.8 2020-11-20T11:51:49.451 INFO:tasks.workunit.client.0.smithi164.stdout:iogen_3.1p0/src/iogen.c 2020-11-20T11:51:49.454 INFO:tasks.workunit.client.0.smithi164.stdout:iogen_3.1p0/README 2020-11-20T11:51:49.462 INFO:tasks.workunit.client.0.smithi164.stdout:iogen_3.1p0/Makefile.bsd 2020-11-20T11:51:49.462 INFO:tasks.workunit.client.0.smithi164.stdout:iogen_3.1p0/Makefile 2020-11-20T11:51:49.463 INFO:tasks.workunit.client.0.smithi164.stdout:making iogen 2020-11-20T11:51:49.474 INFO:tasks.workunit.client.0.smithi164.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2020-11-20T11:51:49.697 INFO:tasks.workunit.client.0.smithi164.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2020-11-20T11:51:49.794 INFO:tasks.workunit.client.0.smithi164.stdout:running iogen 2020-11-20T11:51:49.795 INFO:tasks.workunit.client.0.smithi164.stderr:child spawned 29116 2020-11-20T11:51:49.795 INFO:tasks.workunit.client.0.smithi164.stderr:child spawned 29117 2020-11-20T11:51:49.795 INFO:tasks.workunit.client.0.smithi164.stderr:child spawned 29118 2020-11-20T11:51:49.796 INFO:tasks.workunit.client.0.smithi164.stderr:child spawned 29119 2020-11-20T11:51:49.796 INFO:tasks.workunit.client.0.smithi164.stderr:child spawned 29121 2020-11-20T11:51:49.796 INFO:tasks.workunit.client.0.smithi164.stdout:sleep for 10 min 2020-11-20T11:51:54.491 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:54.494 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:54.497 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:24.582 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:24.930 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:24.937 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:55.024 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:55.328 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:55.332 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:25.633 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:25.636 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:25.639 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:56.100 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:56.106 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:56.120 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:26.425 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:26.452 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:26.872 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:59.889 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:59.893 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:59.900 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:55:30.427 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:55:30.462 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:55:30.465 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:56:00.856 INFO:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:56:01.319 INFO:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:56:01.333 INFO:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:56:03.725 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-20T11:56:03.721+0000 7fa970898700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 25697) UID: 0 2020-11-20T11:56:03.726 INFO:tasks.ceph.osd.4.smithi036.stderr:2020-11-20T11:56:03.721+0000 7f8c41a90700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 25697) UID: 0 2020-11-20T11:56:03.730 INFO:tasks.ceph.osd.7.smithi036.stderr:2020-11-20T11:56:03.724+0000 7f0dd7da1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 25697) UID: 0 2020-11-20T11:56:03.732 INFO:tasks.ceph.osd.10.smithi036.stderr:2020-11-20T11:56:03.724+0000 7fa56c1b0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 25697) UID: 0 2020-11-20T11:56:05.194 INFO:tasks.ceph.osd.2.smithi188.stderr:2020-11-20T11:56:05.190+0000 7fa435ead700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26091) UID: 0 2020-11-20T11:56:05.194 INFO:tasks.ceph.osd.11.smithi188.stderr:2020-11-20T11:56:05.190+0000 7faef6c73700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26091) UID: 0 2020-11-20T11:56:05.194 INFO:tasks.ceph.osd.8.smithi188.stderr:2020-11-20T11:56:05.190+0000 7f767efa1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26091) UID: 0 2020-11-20T11:56:05.198 INFO:tasks.ceph.osd.5.smithi188.stderr:2020-11-20T11:56:05.190+0000 7f83ee7a5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26091) UID: 0 2020-11-20T12:01:50.075 INFO:tasks.workunit.client.0.smithi164.stdout:stopping iogen 2020-11-20T12:01:50.760 INFO:tasks.workunit.client.0.smithi164.stdout:OK 2020-11-20T12:01:53.708 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-11-20T12:01:53.708 INFO:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-11-20T12:01:58.537 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2020-11-20T12:01:58.538 INFO:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-11-20T12:02:19.742 DEBUG:teuthology.parallel:result is None 2020-11-20T12:02:19.743 INFO:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T12:02:19.787 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T12:02:19.787 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-11-20T12:02:19.797 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2020-11-20T12:02:19.797 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi164.front.sepia.ceph.com... 2020-11-20T12:02:19.797 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-11-20T12:02:19.798 INFO:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-11-20T12:02:20.364 INFO:teuthology.orchestra.run:waiting for 900 2020-11-20T12:02:20.534 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:ceph-fuse[28779]: fuse finished with error 0 and tester_r 0 2020-11-20T12:02:26.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T12:02:26.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:02:26.467 INFO:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-11-20T12:02:26.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:02:26.706 INFO:teuthology.orchestra.run.smithi164:> ip netns list 2020-11-20T12:02:27.000 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-11-20T12:02:27.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:02:27.001 INFO:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T12:02:27.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:02:27.040 INFO:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2020-11-20T12:02:27.144 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-11-20T12:02:27.154 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-11-20T12:02:27.154 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:02:28.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.283+0000 7faf37de4700 1 Processor -- start 2020-11-20T12:02:28.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.284+0000 7faf37de4700 1 -- start start 2020-11-20T12:02:28.303 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.284+0000 7faf37de4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faf3007f9e0 0x7faf3015e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.284+0000 7faf37de4700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf300675e0 con 0x7faf300bfc20 2020-11-20T12:02:28.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.284+0000 7faf37de4700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf300c0460 con 0x7faf300c0000 2020-11-20T12:02:28.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.285+0000 7faf37de4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3007fe70 con 0x7faf3007f9e0 2020-11-20T12:02:28.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.285+0000 7faf35b80700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7faf300bfc20 0x7faf300bae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55880/0 (socket says 172.21.15.164:55880) 2020-11-20T12:02:28.304 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.285+0000 7faf35b80700 1 -- 172.21.15.164:0/3886627951 learned_addr learned my addr 172.21.15.164:0/3886627951 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:28.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.285+0000 7faf36381700 1 --2- 172.21.15.164:0/3886627951 >> v2:172.21.15.36:3300/0 conn(0x7faf3007f9e0 0x7faf3015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.285+0000 7faf34b7e700 1 -- 172.21.15.164:0/3886627951 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266187850 0 0) 0x7faf300c0460 con 0x7faf300c0000 2020-11-20T12:02:28.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.298+0000 7faf34b7e700 1 -- 172.21.15.164:0/3886627951 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf1c0031a0 con 0x7faf300c0000 2020-11-20T12:02:28.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.298+0000 7faf36381700 1 -- 172.21.15.164:0/3886627951 >> v1:172.21.15.188:6789/0 conn(0x7faf300c0000 legacy=0x7faf3007f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.305 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.298+0000 7faf36381700 1 -- 172.21.15.164:0/3886627951 >> v1:172.21.15.164:6789/0 conn(0x7faf300bfc20 legacy=0x7faf300bae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.306 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.298+0000 7faf36381700 1 -- 172.21.15.164:0/3886627951 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf30067810 con 0x7faf3007f9e0 2020-11-20T12:02:28.306 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.299+0000 7faf36381700 1 --2- 172.21.15.164:0/3886627951 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf3007f9e0 0x7faf3015e700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7faf28009d10 tx=0x7faf28009220).ready entity=mon.0 client_cookie=14ea941215945a4f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:28.306 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.299+0000 7faf34b7e700 1 -- 172.21.15.164:0/3886627951 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28009e70 con 0x7faf3007f9e0 2020-11-20T12:02:28.308 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.305+0000 7faf34b7e700 1 -- 172.21.15.164:0/3886627951 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2800bbb0 con 0x7faf3007f9e0 2020-11-20T12:02:28.309 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.305+0000 7faf34b7e700 1 -- 172.21.15.164:0/3886627951 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28010470 con 0x7faf3007f9e0 2020-11-20T12:02:28.309 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.305+0000 7faf37de4700 1 -- 172.21.15.164:0/3886627951 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf3007f9e0 msgr2=0x7faf3015e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.310 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.305+0000 7faf37de4700 1 --2- 172.21.15.164:0/3886627951 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf3007f9e0 0x7faf3015e700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7faf28009d10 tx=0x7faf28009220).stop 2020-11-20T12:02:28.310 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.305+0000 7faf37de4700 1 -- 172.21.15.164:0/3886627951 shutdown_connections 2020-11-20T12:02:28.310 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.305+0000 7faf37de4700 1 --2- 172.21.15.164:0/3886627951 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf3007f9e0 0x7faf3015e700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.310 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.305+0000 7faf37de4700 1 -- 172.21.15.164:0/3886627951 >> 172.21.15.164:0/3886627951 conn(0x7faf300601b0 msgr2=0x7faf300605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:28.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.305+0000 7faf37de4700 1 -- 172.21.15.164:0/3886627951 shutdown_connections 2020-11-20T12:02:28.311 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.305+0000 7faf37de4700 1 -- 172.21.15.164:0/3886627951 wait complete. 2020-11-20T12:02:28.317 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.313+0000 7faf37de4700 1 Processor -- start 2020-11-20T12:02:28.317 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.313+0000 7faf37de4700 1 -- start start 2020-11-20T12:02:28.319 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf37de4700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf3007f9e0 0x7faf30174f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.319 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf37de4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf300bfc20 0x7faf30164ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf37de4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf300c0000 0x7faf3015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf37de4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf30175450 con 0x7faf300c0000 2020-11-20T12:02:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf37de4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf301711b0 con 0x7faf300bfc20 2020-11-20T12:02:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf37de4700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf30171450 con 0x7faf3007f9e0 2020-11-20T12:02:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf3537f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf300bfc20 0x7faf30164ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.321 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf3537f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf300bfc20 0x7faf30164ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46142/0 (socket says 172.21.15.164:46142) 2020-11-20T12:02:28.321 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf3537f700 1 -- 172.21.15.164:0/4181006054 learned_addr learned my addr 172.21.15.164:0/4181006054 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:28.321 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf36381700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf300c0000 0x7faf3015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.321 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.314+0000 7faf35b80700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf3007f9e0 0x7faf30174f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf36381700 1 -- 172.21.15.164:0/4181006054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf3007f9e0 msgr2=0x7faf30174f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf36381700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf3007f9e0 0x7faf30174f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf36381700 1 -- 172.21.15.164:0/4181006054 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf300bfc20 msgr2=0x7faf30164ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf36381700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf300bfc20 0x7faf30164ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf36381700 1 -- 172.21.15.164:0/4181006054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf301716f0 con 0x7faf300c0000 2020-11-20T12:02:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf36381700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf300c0000 0x7faf3015dfa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7faf28015000 tx=0x7faf28018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf25ffb700 1 -- 172.21.15.164:0/4181006054 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28019870 con 0x7faf300c0000 2020-11-20T12:02:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf25ffb700 1 -- 172.21.15.164:0/4181006054 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf280199d0 con 0x7faf300c0000 2020-11-20T12:02:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf25ffb700 1 -- 172.21.15.164:0/4181006054 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28019d70 con 0x7faf300c0000 2020-11-20T12:02:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf37de4700 1 -- 172.21.15.164:0/4181006054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf30171990 con 0x7faf300c0000 2020-11-20T12:02:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.315+0000 7faf37de4700 1 -- 172.21.15.164:0/4181006054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf30171ed0 con 0x7faf300c0000 2020-11-20T12:02:28.325 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.317+0000 7faf37de4700 1 -- 172.21.15.164:0/4181006054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf30069b70 con 0x7faf300c0000 2020-11-20T12:02:28.325 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.317+0000 7faf25ffb700 1 -- 172.21.15.164:0/4181006054 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7faf28028020 con 0x7faf300c0000 2020-11-20T12:02:28.325 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.318+0000 7faf25ffb700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf080806a0 0x7faf08082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.326 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.318+0000 7faf25ffb700 1 -- 172.21.15.164:0/4181006054 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7faf280a49c0 con 0x7faf300c0000 2020-11-20T12:02:28.326 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.318+0000 7faf35b80700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf080806a0 0x7faf08082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.343+0000 7faf35b80700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf080806a0 0x7faf08082b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7faf2c000c00 tx=0x7faf2c009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:28.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.347+0000 7faf25ffb700 1 -- 172.21.15.164:0/4181006054 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7faf280793d0 con 0x7faf300c0000 2020-11-20T12:02:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.489+0000 7faf37de4700 1 -- 172.21.15.164:0/4181006054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf30061630 con 0x7faf300c0000 2020-11-20T12:02:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.490+0000 7faf25ffb700 1 -- 172.21.15.164:0/4181006054 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7faf2807c9f0 con 0x7faf300c0000 2020-11-20T12:02:28.495 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T12:02:28.496 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:39.612589+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:50:34.615204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:50:37.302647+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:02:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 -- 172.21.15.164:0/4181006054 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf080806a0 msgr2=0x7faf08082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf080806a0 0x7faf08082b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7faf2c000c00 tx=0x7faf2c009040).stop 2020-11-20T12:02:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 -- 172.21.15.164:0/4181006054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf300c0000 msgr2=0x7faf3015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf300c0000 0x7faf3015dfa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7faf28015000 tx=0x7faf28018000).stop 2020-11-20T12:02:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 -- 172.21.15.164:0/4181006054 shutdown_connections 2020-11-20T12:02:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faf080806a0 0x7faf08082b60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf300c0000 0x7faf3015dfa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf3007f9e0 0x7faf30174f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 --2- 172.21.15.164:0/4181006054 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf300bfc20 0x7faf30164ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 -- 172.21.15.164:0/4181006054 >> 172.21.15.164:0/4181006054 conn(0x7faf300601b0 msgr2=0x7faf300be890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 -- 172.21.15.164:0/4181006054 shutdown_connections 2020-11-20T12:02:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.492+0000 7faf37de4700 1 -- 172.21.15.164:0/4181006054 wait complete. 2020-11-20T12:02:28.509 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:02:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.615+0000 7f86bc8b0700 1 Processor -- start 2020-11-20T12:02:28.620 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.615+0000 7f86bc8b0700 1 -- start start 2020-11-20T12:02:28.621 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.616+0000 7f86bc8b0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f86b80c4740 0x7f86b81550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.622 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.616+0000 7f86bc8b0700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f86b8150520 0x7f86b8150950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.622 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.616+0000 7f86bc8b0700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b81555e0 con 0x7f86b80c4360 2020-11-20T12:02:28.622 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.616+0000 7f86bc8b0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b80bd090 con 0x7f86b80c4740 2020-11-20T12:02:28.623 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.616+0000 7f86bc8b0700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b80c4b80 con 0x7f86b8150520 2020-11-20T12:02:28.623 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.616+0000 7f86b659c700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f86b80c4360 0x7f86b80bfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55890/0 (socket says 172.21.15.164:55890) 2020-11-20T12:02:28.623 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.616+0000 7f86b659c700 1 -- 172.21.15.164:0/3526911848 learned_addr learned my addr 172.21.15.164:0/3526911848 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:28.623 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.616+0000 7f86b6d9d700 1 --2- 172.21.15.164:0/3526911848 >> v2:172.21.15.188:3300/0 conn(0x7f86b8150520 0x7f86b8150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.623 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.616+0000 7f86b5d9b700 1 --2- 172.21.15.164:0/3526911848 >> v2:172.21.15.36:3300/0 conn(0x7f86b80c4740 0x7f86b81550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.617+0000 7f86b6d9d700 1 -- 172.21.15.164:0/3526911848 >> v2:172.21.15.36:3300/0 conn(0x7f86b80c4740 msgr2=0x7f86b81550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:28.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.617+0000 7f86b6d9d700 1 --2- 172.21.15.164:0/3526911848 >> v2:172.21.15.36:3300/0 conn(0x7f86b80c4740 0x7f86b81550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.617+0000 7f86b6d9d700 1 -- 172.21.15.164:0/3526911848 >> v1:172.21.15.164:6789/0 conn(0x7f86b80c4360 legacy=0x7f86b80bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.617+0000 7f86b6d9d700 1 -- 172.21.15.164:0/3526911848 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b8151220 con 0x7f86b8150520 2020-11-20T12:02:28.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.617+0000 7f86b6d9d700 1 --2- 172.21.15.164:0/3526911848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b8150520 0x7f86b8150950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f86b80bd1d0 tx=0x7f86b0009220).ready entity=mon.2 client_cookie=46c0968b80b635ff server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:28.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.617+0000 7f86b559a700 1 -- 172.21.15.164:0/3526911848 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000b9d0 con 0x7f86b8150520 2020-11-20T12:02:28.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.617+0000 7f86b559a700 1 -- 172.21.15.164:0/3526911848 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000bb30 con 0x7f86b8150520 2020-11-20T12:02:28.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.617+0000 7f86b559a700 1 -- 172.21.15.164:0/3526911848 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0011400 con 0x7f86b8150520 2020-11-20T12:02:28.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.618+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3526911848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b8150520 msgr2=0x7f86b8150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.618+0000 7f86bc8b0700 1 --2- 172.21.15.164:0/3526911848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b8150520 0x7f86b8150950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f86b80bd1d0 tx=0x7f86b0009220).stop 2020-11-20T12:02:28.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.618+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3526911848 shutdown_connections 2020-11-20T12:02:28.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.618+0000 7f86bc8b0700 1 --2- 172.21.15.164:0/3526911848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b8150520 0x7f86b8150950 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.618+0000 7f86bc8b0700 1 --2- 172.21.15.164:0/3526911848 >> v2:172.21.15.36:3300/0 conn(0x7f86b80c4740 0x7f86b81550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.618+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3526911848 >> 172.21.15.164:0/3526911848 conn(0x7f86b80619e0 msgr2=0x7f86b8061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:28.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.618+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3526911848 shutdown_connections 2020-11-20T12:02:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.618+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3526911848 wait complete. 2020-11-20T12:02:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.619+0000 7f86bc8b0700 1 Processor -- start 2020-11-20T12:02:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.619+0000 7f86bc8b0700 1 -- start start 2020-11-20T12:02:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86bc8b0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86b80c4360 0x7f86b8160d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86bc8b0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86b80c4740 0x7f86b8112270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86bc8b0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b8150520 0x7f86b8155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86bc8b0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8112b60 con 0x7f86b80c4360 2020-11-20T12:02:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86bc8b0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b81578d0 con 0x7f86b80c4740 2020-11-20T12:02:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86bc8b0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8157b70 con 0x7f86b8150520 2020-11-20T12:02:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b5d9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86b80c4740 0x7f86b8112270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b5d9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86b80c4740 0x7f86b8112270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46158/0 (socket says 172.21.15.164:46158) 2020-11-20T12:02:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b5d9b700 1 -- 172.21.15.164:0/3662462147 learned_addr learned my addr 172.21.15.164:0/3662462147 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b6d9d700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b8150520 0x7f86b8155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b659c700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86b80c4360 0x7f86b8160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b6d9d700 1 -- 172.21.15.164:0/3662462147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86b80c4740 msgr2=0x7f86b8112270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b6d9d700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86b80c4740 0x7f86b8112270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b6d9d700 1 -- 172.21.15.164:0/3662462147 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86b80c4360 msgr2=0x7f86b8160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b6d9d700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86b80c4360 0x7f86b8160d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b6d9d700 1 -- 172.21.15.164:0/3662462147 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b8157e10 con 0x7f86b8150520 2020-11-20T12:02:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86b6d9d700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b8150520 0x7f86b8155c10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f86b0013000 tx=0x7f86b0016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.620+0000 7f86a67fc700 1 -- 172.21.15.164:0/3662462147 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b001c750 con 0x7f86b8150520 2020-11-20T12:02:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.621+0000 7f86a67fc700 1 -- 172.21.15.164:0/3662462147 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b001c8b0 con 0x7f86b8150520 2020-11-20T12:02:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.621+0000 7f86a67fc700 1 -- 172.21.15.164:0/3662462147 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b001cc50 con 0x7f86b8150520 2020-11-20T12:02:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.621+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3662462147 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b81580b0 con 0x7f86b8150520 2020-11-20T12:02:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.621+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3662462147 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b8161270 con 0x7f86b8150520 2020-11-20T12:02:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.621+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3662462147 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b8158910 con 0x7f86b8150520 2020-11-20T12:02:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.622+0000 7f86a67fc700 1 -- 172.21.15.164:0/3662462147 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f86b0017070 con 0x7f86b8150520 2020-11-20T12:02:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.623+0000 7f86a67fc700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f868c080670 0x7f868c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.623+0000 7f86a67fc700 1 -- 172.21.15.164:0/3662462147 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f86b00a5790 con 0x7f86b8150520 2020-11-20T12:02:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.623+0000 7f86b659c700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f868c080670 0x7f868c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.623+0000 7f86b659c700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f868c080670 0x7f868c082b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f86a8000c00 tx=0x7f86a8009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.626+0000 7f86a67fc700 1 -- 172.21.15.164:0/3662462147 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f86b007a100 con 0x7f86b8150520 2020-11-20T12:02:28.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.766+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3662462147 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86b8161270 con 0x7f868c080670 2020-11-20T12:02:28.806 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.799+0000 7f86a67fc700 1 -- 172.21.15.164:0/3662462147 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151013 (secure 0 0 0) 0x7f86b8161270 con 0x7f868c080670 2020-11-20T12:02:28.806 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3662462147 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f868c080670 msgr2=0x7f868c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.806 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f868c080670 0x7f868c082b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f86a8000c00 tx=0x7f86a8009040).stop 2020-11-20T12:02:28.807 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3662462147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b8150520 msgr2=0x7f86b8155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.807 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b8150520 0x7f86b8155c10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f86b0013000 tx=0x7f86b0016000).stop 2020-11-20T12:02:28.807 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3662462147 shutdown_connections 2020-11-20T12:02:28.807 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f868c080670 0x7f868c082b30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.807 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86b8150520 0x7f86b8155c10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.808 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86b80c4360 0x7f86b8160d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.808 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 --2- 172.21.15.164:0/3662462147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86b80c4740 0x7f86b8112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.808 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3662462147 >> 172.21.15.164:0/3662462147 conn(0x7f86b80619e0 msgr2=0x7f86b80c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:28.808 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3662462147 shutdown_connections 2020-11-20T12:02:28.809 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.801+0000 7f86bc8b0700 1 -- 172.21.15.164:0/3662462147 wait complete. 2020-11-20T12:02:28.809 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2020-11-20T12:02:28.809 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T12:02:28.817 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":379,"stamp":"2020-11-20T12:02:28.306009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384264,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":68039,"num_read_kb":4839627,"num_write":247435,"num_write_kb":25840763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80625,"ondisk_log_size":80625,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3534216,"kb_used_data":4264,"kb_used_omap":0,"kb_used_meta":3529856,"kb_avail":1128927864,"statfs":{"total":1159641169920,"available":1156022132736,"internally_reserved":0,"allocated":4366336,"data_stored":2398982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3614572544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4269,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002787"},"pg_stats":[{"pgid":"4.2","version":"28'28576","reported_seq":"36765","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.351466+0000","last_change":"2020-11-20T11:50:39.389929+0000","last_active":"2020-11-20T12:02:11.351466+0000","last_peered":"2020-11-20T12:02:11.351466+0000","last_clean":"2020-11-20T12:02:11.351466+0000","last_became_active":"2020-11-20T11:50:39.389230+0000","last_became_peered":"2020-11-20T11:50:39.389230+0000","last_unstale":"2020-11-20T12:02:11.351466+0000","last_undegraded":"2020-11-20T12:02:11.351466+0000","last_fullsized":"2020-11-20T12:02:11.351466+0000","mapping_epoch":26,"log_start":"28'18500","ondisk_log_start":"28'18500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10076,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8178,"num_read_kb":581860,"num_write":29951,"num_write_kb":3122376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,0],"acting":[9,10,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.313704+0000","last_change":"2020-11-20T11:50:33.149836+0000","last_active":"2020-11-20T11:50:39.313704+0000","last_peered":"2020-11-20T11:50:39.313704+0000","last_clean":"2020-11-20T11:50:39.313704+0000","last_became_active":"2020-11-20T11:50:33.149402+0000","last_became_peered":"2020-11-20T11:50:33.149402+0000","last_unstale":"2020-11-20T11:50:39.313704+0000","last_undegraded":"2020-11-20T11:50:39.313704+0000","last_fullsized":"2020-11-20T11:50:39.313704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'10","reported_seq":"22","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.431814+0000","last_change":"2020-11-20T11:50:36.273858+0000","last_active":"2020-11-20T12:02:11.431814+0000","last_peered":"2020-11-20T12:02:11.431814+0000","last_clean":"2020-11-20T12:02:11.431814+0000","last_became_active":"2020-11-20T11:50:36.273570+0000","last_became_peered":"2020-11-20T11:50:36.273570+0000","last_unstale":"2020-11-20T12:02:11.431814+0000","last_undegraded":"2020-11-20T12:02:11.431814+0000","last_fullsized":"2020-11-20T12:02:11.431814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"28'30631","reported_seq":"39450","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.325393+0000","last_change":"2020-11-20T11:50:39.280178+0000","last_active":"2020-11-20T12:02:11.325393+0000","last_peered":"2020-11-20T12:02:11.325393+0000","last_clean":"2020-11-20T12:02:11.325393+0000","last_became_active":"2020-11-20T11:50:39.279495+0000","last_became_peered":"2020-11-20T11:50:39.279495+0000","last_unstale":"2020-11-20T12:02:11.325393+0000","last_undegraded":"2020-11-20T12:02:11.325393+0000","last_fullsized":"2020-11-20T12:02:11.325393+0000","mapping_epoch":26,"log_start":"28'20602","ondisk_log_start":"28'20602","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10029,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8808,"num_read_kb":624576,"num_write":32062,"num_write_kb":3350923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,6],"acting":[8,2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270526+0000","last_change":"2020-11-20T11:50:33.144081+0000","last_active":"2020-11-20T11:50:39.270526+0000","last_peered":"2020-11-20T11:50:39.270526+0000","last_clean":"2020-11-20T11:50:39.270526+0000","last_became_active":"2020-11-20T11:50:33.143591+0000","last_became_peered":"2020-11-20T11:50:33.143591+0000","last_unstale":"2020-11-20T11:50:39.270526+0000","last_undegraded":"2020-11-20T11:50:39.270526+0000","last_fullsized":"2020-11-20T11:50:39.270526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.630243+0000","last_change":"2020-11-20T11:50:36.456248+0000","last_active":"2020-11-20T11:50:39.630243+0000","last_peered":"2020-11-20T11:50:39.630243+0000","last_clean":"2020-11-20T11:50:39.630243+0000","last_became_active":"2020-11-20T11:50:36.455930+0000","last_became_peered":"2020-11-20T11:50:36.455930+0000","last_unstale":"2020-11-20T11:50:39.630243+0000","last_undegraded":"2020-11-20T11:50:39.630243+0000","last_fullsized":"2020-11-20T11:50:39.630243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"28'26515","reported_seq":"34215","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.401155+0000","last_change":"2020-11-20T11:50:39.278909+0000","last_active":"2020-11-20T12:02:11.401155+0000","last_peered":"2020-11-20T12:02:11.401155+0000","last_clean":"2020-11-20T12:02:11.401155+0000","last_became_active":"2020-11-20T11:50:39.278305+0000","last_became_peered":"2020-11-20T11:50:39.278305+0000","last_unstale":"2020-11-20T12:02:11.401155+0000","last_undegraded":"2020-11-20T12:02:11.401155+0000","last_fullsized":"2020-11-20T12:02:11.401155+0000","mapping_epoch":26,"log_start":"28'16500","ondisk_log_start":"28'16500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10015,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7689,"num_read_kb":545912,"num_write":27745,"num_write_kb":2901671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,8,9],"acting":[2,0,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.273540+0000","last_change":"2020-11-20T11:50:33.149828+0000","last_active":"2020-11-20T11:50:39.273540+0000","last_peered":"2020-11-20T11:50:39.273540+0000","last_clean":"2020-11-20T11:50:39.273540+0000","last_became_active":"2020-11-20T11:50:33.149428+0000","last_became_peered":"2020-11-20T11:50:33.149428+0000","last_unstale":"2020-11-20T11:50:39.273540+0000","last_undegraded":"2020-11-20T11:50:39.273540+0000","last_fullsized":"2020-11-20T11:50:39.273540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'9","reported_seq":"21","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.629215+0000","last_change":"2020-11-20T11:50:37.249871+0000","last_active":"2020-11-20T11:50:39.629215+0000","last_peered":"2020-11-20T11:50:39.629215+0000","last_clean":"2020-11-20T11:50:39.629215+0000","last_became_active":"2020-11-20T11:50:37.249478+0000","last_became_peered":"2020-11-20T11:50:37.249478+0000","last_unstale":"2020-11-20T11:50:39.629215+0000","last_undegraded":"2020-11-20T11:50:39.629215+0000","last_fullsized":"2020-11-20T11:50:39.629215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"28'29200","reported_seq":"37743","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.374603+0000","last_change":"2020-11-20T11:50:39.315989+0000","last_active":"2020-11-20T12:02:11.374603+0000","last_peered":"2020-11-20T12:02:11.374603+0000","last_clean":"2020-11-20T12:02:11.374603+0000","last_became_active":"2020-11-20T11:50:39.315322+0000","last_became_peered":"2020-11-20T11:50:39.315322+0000","last_unstale":"2020-11-20T12:02:11.374603+0000","last_undegraded":"2020-11-20T12:02:11.374603+0000","last_fullsized":"2020-11-20T12:02:11.374603+0000","mapping_epoch":26,"log_start":"28'19100","ondisk_log_start":"28'19100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10100,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8532,"num_read_kb":608812,"num_write":30604,"num_write_kb":3202634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1,3],"acting":[7,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.312978+0000","last_change":"2020-11-20T11:50:33.453134+0000","last_active":"2020-11-20T11:50:39.312978+0000","last_peered":"2020-11-20T11:50:39.312978+0000","last_clean":"2020-11-20T11:50:39.312978+0000","last_became_active":"2020-11-20T11:50:33.452821+0000","last_became_peered":"2020-11-20T11:50:33.452821+0000","last_unstale":"2020-11-20T11:50:39.312978+0000","last_undegraded":"2020-11-20T11:50:39.312978+0000","last_fullsized":"2020-11-20T11:50:39.312978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270532+0000","last_change":"2020-11-20T11:50:28.351977+0000","last_active":"2020-11-20T11:50:39.270532+0000","last_peered":"2020-11-20T11:50:39.270532+0000","last_clean":"2020-11-20T11:50:39.270532+0000","last_became_active":"2020-11-20T11:50:28.351248+0000","last_became_peered":"2020-11-20T11:50:28.351248+0000","last_unstale":"2020-11-20T11:50:39.270532+0000","last_undegraded":"2020-11-20T11:50:39.270532+0000","last_fullsized":"2020-11-20T11:50:39.270532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:22.155217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:22.155217+0000","last_clean_scrub_stamp":"2020-11-20T11:50:22.155217+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"13","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.621397+0000","last_change":"2020-11-20T11:50:36.274590+0000","last_active":"2020-11-20T11:50:39.621397+0000","last_peered":"2020-11-20T11:50:39.621397+0000","last_clean":"2020-11-20T11:50:39.621397+0000","last_became_active":"2020-11-20T11:50:36.274158+0000","last_became_peered":"2020-11-20T11:50:36.274158+0000","last_unstale":"2020-11-20T11:50:39.621397+0000","last_undegraded":"2020-11-20T11:50:39.621397+0000","last_fullsized":"2020-11-20T11:50:39.621397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"28'31861","reported_seq":"41154","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.362913+0000","last_change":"2020-11-20T11:50:39.390204+0000","last_active":"2020-11-20T12:02:11.362913+0000","last_peered":"2020-11-20T12:02:11.362913+0000","last_clean":"2020-11-20T12:02:11.362913+0000","last_became_active":"2020-11-20T11:50:39.389493+0000","last_became_peered":"2020-11-20T11:50:39.389493+0000","last_unstale":"2020-11-20T12:02:11.362913+0000","last_undegraded":"2020-11-20T12:02:11.362913+0000","last_fullsized":"2020-11-20T12:02:11.362913+0000","mapping_epoch":26,"log_start":"28'21800","ondisk_log_start":"28'21800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10061,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9282,"num_read_kb":661352,"num_write":33383,"num_write_kb":3474570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2,10],"acting":[9,8,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270533+0000","last_change":"2020-11-20T11:50:33.144765+0000","last_active":"2020-11-20T11:50:39.270533+0000","last_peered":"2020-11-20T11:50:39.270533+0000","last_clean":"2020-11-20T11:50:39.270533+0000","last_became_active":"2020-11-20T11:50:33.144316+0000","last_became_peered":"2020-11-20T11:50:33.144316+0000","last_unstale":"2020-11-20T11:50:39.270533+0000","last_undegraded":"2020-11-20T11:50:39.270533+0000","last_fullsized":"2020-11-20T11:50:39.270533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'4","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:20.802188+0000","last_change":"2020-11-20T11:50:36.456553+0000","last_active":"2020-11-20T12:02:20.802188+0000","last_peered":"2020-11-20T12:02:20.802188+0000","last_clean":"2020-11-20T12:02:20.802188+0000","last_became_active":"2020-11-20T11:50:36.456244+0000","last_became_peered":"2020-11-20T11:50:36.456244+0000","last_unstale":"2020-11-20T12:02:20.802188+0000","last_undegraded":"2020-11-20T12:02:20.802188+0000","last_fullsized":"2020-11-20T12:02:20.802188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2121,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":3,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"28'28831","reported_seq":"37235","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.254780+0000","last_change":"2020-11-20T11:50:39.316003+0000","last_active":"2020-11-20T12:02:11.254780+0000","last_peered":"2020-11-20T12:02:11.254780+0000","last_clean":"2020-11-20T12:02:11.254780+0000","last_became_active":"2020-11-20T11:50:39.315185+0000","last_became_peered":"2020-11-20T11:50:39.315185+0000","last_unstale":"2020-11-20T12:02:11.254780+0000","last_undegraded":"2020-11-20T12:02:11.254780+0000","last_fullsized":"2020-11-20T12:02:11.254780+0000","mapping_epoch":26,"log_start":"28'18800","ondisk_log_start":"28'18800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10031,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8393,"num_read_kb":600024,"num_write":30168,"num_write_kb":3162593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,11],"acting":[0,2,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.313009+0000","last_change":"2020-11-20T11:50:33.146356+0000","last_active":"2020-11-20T11:50:39.313009+0000","last_peered":"2020-11-20T11:50:39.313009+0000","last_clean":"2020-11-20T11:50:39.313009+0000","last_became_active":"2020-11-20T11:50:33.146090+0000","last_became_peered":"2020-11-20T11:50:33.146090+0000","last_unstale":"2020-11-20T11:50:39.313009+0000","last_undegraded":"2020-11-20T11:50:39.313009+0000","last_fullsized":"2020-11-20T11:50:39.313009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'126","reported_seq":"138","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:20.598499+0000","last_change":"2020-11-20T11:50:36.274051+0000","last_active":"2020-11-20T12:02:20.598499+0000","last_peered":"2020-11-20T12:02:20.598499+0000","last_clean":"2020-11-20T12:02:20.598499+0000","last_became_active":"2020-11-20T11:50:36.273653+0000","last_became_peered":"2020-11-20T11:50:36.273653+0000","last_unstale":"2020-11-20T12:02:20.598499+0000","last_undegraded":"2020-11-20T12:02:20.598499+0000","last_fullsized":"2020-11-20T12:02:20.598499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":126,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":381374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"28'30345","reported_seq":"38993","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.358084+0000","last_change":"2020-11-20T11:50:39.390131+0000","last_active":"2020-11-20T12:02:11.358084+0000","last_peered":"2020-11-20T12:02:11.358084+0000","last_clean":"2020-11-20T12:02:11.358084+0000","last_became_active":"2020-11-20T11:50:39.389272+0000","last_became_peered":"2020-11-20T11:50:39.389272+0000","last_unstale":"2020-11-20T12:02:11.358084+0000","last_undegraded":"2020-11-20T12:02:11.358084+0000","last_fullsized":"2020-11-20T12:02:11.358084+0000","mapping_epoch":26,"log_start":"28'20300","ondisk_log_start":"28'20300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10045,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8637,"num_read_kb":612900,"num_write":31806,"num_write_kb":3327179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,11,7],"acting":[5,10,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'7","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.628793+0000","last_change":"2020-11-20T11:50:37.249008+0000","last_active":"2020-11-20T11:50:39.628793+0000","last_peered":"2020-11-20T11:50:39.628793+0000","last_clean":"2020-11-20T11:50:39.628793+0000","last_became_active":"2020-11-20T11:50:37.248661+0000","last_became_peered":"2020-11-20T11:50:37.248661+0000","last_unstale":"2020-11-20T11:50:39.628793+0000","last_undegraded":"2020-11-20T11:50:39.628793+0000","last_fullsized":"2020-11-20T11:50:39.628793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.271281+0000","last_change":"2020-11-20T11:50:33.395499+0000","last_active":"2020-11-20T11:50:39.271281+0000","last_peered":"2020-11-20T11:50:39.271281+0000","last_clean":"2020-11-20T11:50:39.271281+0000","last_became_active":"2020-11-20T11:50:33.395209+0000","last_became_peered":"2020-11-20T11:50:33.395209+0000","last_unstale":"2020-11-20T11:50:39.271281+0000","last_undegraded":"2020-11-20T11:50:39.271281+0000","last_fullsized":"2020-11-20T11:50:39.271281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"28'30089","reported_seq":"38618","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.304921+0000","last_change":"2020-11-20T11:50:39.315204+0000","last_active":"2020-11-20T12:02:11.304921+0000","last_peered":"2020-11-20T12:02:11.304921+0000","last_clean":"2020-11-20T12:02:11.304921+0000","last_became_active":"2020-11-20T11:50:39.314678+0000","last_became_peered":"2020-11-20T11:50:39.314678+0000","last_unstale":"2020-11-20T12:02:11.304921+0000","last_undegraded":"2020-11-20T12:02:11.304921+0000","last_fullsized":"2020-11-20T12:02:11.304921+0000","mapping_epoch":26,"log_start":"28'20000","ondisk_log_start":"28'20000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8518,"num_read_kb":604188,"num_write":31532,"num_write_kb":3298368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,7],"acting":[6,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.312979+0000","last_change":"2020-11-20T11:50:33.395626+0000","last_active":"2020-11-20T11:50:39.312979+0000","last_peered":"2020-11-20T11:50:39.312979+0000","last_clean":"2020-11-20T11:50:39.312979+0000","last_became_active":"2020-11-20T11:50:33.395281+0000","last_became_peered":"2020-11-20T11:50:33.395281+0000","last_unstale":"2020-11-20T11:50:39.312979+0000","last_undegraded":"2020-11-20T11:50:39.312979+0000","last_fullsized":"2020-11-20T11:50:39.312979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'13","reported_seq":"25","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:08.300881+0000","last_change":"2020-11-20T11:50:36.274786+0000","last_active":"2020-11-20T12:02:08.300881+0000","last_peered":"2020-11-20T12:02:08.300881+0000","last_clean":"2020-11-20T12:02:08.300881+0000","last_became_active":"2020-11-20T11:50:36.274438+0000","last_became_peered":"2020-11-20T11:50:36.274438+0000","last_unstale":"2020-11-20T12:02:08.300881+0000","last_undegraded":"2020-11-20T12:02:08.300881+0000","last_fullsized":"2020-11-20T12:02:08.300881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68037,"num_read_kb":4839624,"num_write":247251,"num_write_kb":25840314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80446,"ondisk_log_size":80446,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":384264,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":3,"num_write":181,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":768528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":176,"ondisk_log_size":176,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444178,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230124,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":229824,"kb_avail":94141716,"statfs":{"total":96636764160,"available":96401117184,"internally_reserved":0,"allocated":299008,"data_stored":138092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":235339776},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":2.427,"15min":1.909},"min":{"1min":0.628,"5min":0.57399999999999995,"15min":0.56799999999999995},"max":{"1min":6.5979999999999999,"5min":45.957000000000001,"15min":56.518000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":2.238,"5min":2.5720000000000001,"15min":1.988},"min":{"1min":0.67200000000000004,"5min":0.59199999999999997,"15min":0.56399999999999995},"max":{"1min":6.6349999999999998,"5min":46.25,"15min":57.197000000000003},"last":1.256}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":7.173,"5min":6.7859999999999996,"15min":3.2650000000000001},"min":{"1min":0.66300000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":24.568000000000001,"5min":44.758000000000003,"15min":44.758000000000003},"last":0.98399999999999999},{"interface":"front","average":{"1min":6.234,"5min":6.258,"15min":3.0539999999999998},"min":{"1min":0.81899999999999995,"5min":0.64000000000000001,"15min":0.624},"max":{"1min":23.788,"5min":44.119,"15min":44.119},"last":1.3260000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.9870000000000001,"15min":1.669},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":4.3470000000000004,"5min":39.085000000000001,"15min":39.085000000000001},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.7110000000000001,"5min":2.5259999999999998,"15min":1.952},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":7.8300000000000001,"5min":39.098999999999997,"15min":39.098999999999997},"last":1.151}]},{"osd":4,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":2.7040000000000002,"15min":1.921},"min":{"1min":0.76500000000000001,"5min":0.69699999999999995,"15min":0.63400000000000001},"max":{"1min":7.3010000000000002,"5min":64.099000000000004,"15min":64.099000000000004},"last":1.393},{"interface":"front","average":{"1min":1.4019999999999999,"5min":2.3170000000000002,"15min":1.74},"min":{"1min":0.75900000000000001,"5min":0.69699999999999995,"15min":0.58899999999999997},"max":{"1min":3.4609999999999999,"5min":64.334999999999994,"15min":64.334999999999994},"last":1.1870000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":2.9159999999999999,"15min":2.105},"min":{"1min":0.79400000000000004,"5min":0.747,"15min":0.66100000000000003},"max":{"1min":8.2919999999999998,"5min":34.286999999999999,"15min":34.286999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":2.3319999999999999,"5min":3.3719999999999999,"15min":2.3879999999999999},"min":{"1min":1.0489999999999999,"5min":0.86499999999999999,"15min":0.80000000000000004},"max":{"1min":7.6479999999999997,"5min":34.472999999999999,"15min":34.472999999999999},"last":1.55}]},{"osd":6,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":3.0939999999999999,"5min":3.2530000000000001,"15min":2.5430000000000001},"min":{"1min":0.94199999999999995,"5min":0.621,"15min":0.621},"max":{"1min":18.669,"5min":46.186,"15min":58.046999999999997},"last":1.4670000000000001},{"interface":"front","average":{"1min":3.2240000000000002,"5min":3.7789999999999999,"15min":2.8260000000000001},"min":{"1min":1.056,"5min":1.028,"15min":0.91900000000000004},"max":{"1min":19.599,"5min":46.640000000000001,"15min":57.896000000000001},"last":1.508}]},{"osd":7,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":7.1150000000000002,"5min":5.3940000000000001,"15min":3.0710000000000002},"min":{"1min":1.2310000000000001,"5min":1.044,"15min":0.91600000000000004},"max":{"1min":29.625,"5min":65.272999999999996,"15min":65.272999999999996},"last":1.706},{"interface":"front","average":{"1min":6.5970000000000004,"5min":5.1699999999999999,"15min":2.9790000000000001},"min":{"1min":1.008,"5min":0.871,"15min":0.871},"max":{"1min":29.451000000000001,"5min":64.081000000000003,"15min":64.081000000000003},"last":1.738}]},{"osd":8,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":8.2699999999999996,"5min":6.4809999999999999,"15min":3.536},"min":{"1min":1.292,"5min":1.1200000000000001,"15min":1.006},"max":{"1min":45.953000000000003,"5min":45.953000000000003,"15min":45.953000000000003},"last":1.659},{"interface":"front","average":{"1min":8.2309999999999999,"5min":6.2210000000000001,"15min":3.419},"min":{"1min":1.175,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":46.667000000000002,"5min":46.667000000000002,"15min":46.667000000000002},"last":1.8440000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:02:03 2020","interfaces":[{"interface":"back","average":{"1min":2.246,"5min":3.2730000000000001,"15min":2.6920000000000002},"min":{"1min":1.23,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":8.2929999999999993,"5min":47.347999999999999,"15min":58.792000000000002},"last":1.877},{"interface":"front","average":{"1min":2.4100000000000001,"5min":3.6859999999999999,"15min":2.9729999999999999},"min":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"max":{"1min":8.0649999999999995,"5min":46.463000000000001,"15min":58.162999999999997},"last":1.786}]},{"osd":10,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":3.0110000000000001,"5min":4.4530000000000003,"15min":2.9399999999999999},"min":{"1min":1.1859999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"max":{"1min":15.298,"5min":65.462000000000003,"15min":65.462000000000003},"last":1.9159999999999999},{"interface":"front","average":{"1min":3.137,"5min":4.2889999999999997,"15min":2.843},"min":{"1min":1.2729999999999999,"5min":1.143,"15min":1.143},"max":{"1min":15.246,"5min":64.566999999999993,"15min":64.566999999999993},"last":1.97}]}]},{"osd":10,"up_from":17,"seq":73014444178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341748,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":341440,"kb_avail":94030092,"statfs":{"total":96636764160,"available":96286814208,"internally_reserved":0,"allocated":307200,"data_stored":136165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":349634560},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":1,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":4.2489999999999997,"5min":2.7370000000000001,"15min":1.7250000000000001},"min":{"1min":0.68000000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":36.079999999999998,"5min":36.079999999999998,"15min":36.079999999999998},"last":0.872},{"interface":"front","average":{"1min":4.7220000000000004,"5min":3.391,"15min":2.02},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":36.460000000000001,"5min":37.271999999999998,"15min":37.271999999999998},"last":1.246}]},{"osd":2,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":18.879000000000001,"5min":10.077999999999999,"15min":4.2530000000000001},"min":{"1min":0.76400000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":58.145000000000003,"5min":58.145000000000003,"15min":58.145000000000003},"last":1.3260000000000001},{"interface":"front","average":{"1min":17.375,"5min":10.433999999999999,"15min":4.6440000000000001},"min":{"1min":0.95799999999999996,"5min":0.78000000000000003,"15min":0.64600000000000002},"max":{"1min":58.229999999999997,"5min":58.229999999999997,"15min":58.229999999999997},"last":1.4470000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":6.0990000000000002,"5min":4.4489999999999998,"15min":2.472},"min":{"1min":0.747,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":35.633000000000003,"5min":37.094000000000001,"15min":37.094000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":5.726,"5min":4.5910000000000002,"15min":2.6440000000000001},"min":{"1min":0.85699999999999998,"5min":0.753,"15min":0.753},"max":{"1min":35.667000000000002,"5min":35.667000000000002,"15min":35.667000000000002},"last":1.286}]},{"osd":4,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":4.2649999999999997,"5min":6.8730000000000002,"15min":3.3450000000000002},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":36.332000000000001,"5min":256.52499999999998,"15min":256.52499999999998},"last":1.0629999999999999},{"interface":"front","average":{"1min":4.673,"5min":7.4020000000000001,"15min":3.5030000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":35.771000000000001,"5min":259.17500000000001,"15min":259.17500000000001},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":5.6980000000000004,"5min":5.7839999999999998,"15min":3.1659999999999999},"min":{"1min":0.79900000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":36.603000000000002,"5min":37.502000000000002,"15min":37.502000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":7.4130000000000003,"5min":5.242,"15min":3.0289999999999999},"min":{"1min":0.91400000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":36.499000000000002,"5min":37.375999999999998,"15min":37.375999999999998},"last":1.488}]},{"osd":6,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":10.222,"5min":6.2229999999999999,"15min":3.5289999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.78100000000000003},"max":{"1min":64.608999999999995,"5min":64.608999999999995,"15min":64.608999999999995},"last":1.609},{"interface":"front","average":{"1min":6.9640000000000004,"5min":6.4390000000000001,"15min":3.5670000000000002},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":36.845999999999997,"5min":39.478000000000002,"15min":39.478000000000002},"last":1.677}]},{"osd":7,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":13.191000000000001,"5min":9.6660000000000004,"15min":4.5359999999999996},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0069999999999999},"max":{"1min":64.647999999999996,"5min":64.647999999999996,"15min":64.647999999999996},"last":1.649},{"interface":"front","average":{"1min":15.058999999999999,"5min":8.9890000000000008,"15min":4.3360000000000003},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":64.965000000000003,"5min":64.965000000000003,"15min":64.965000000000003},"last":1.7629999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:02:00 2020","interfaces":[{"interface":"back","average":{"1min":14.737,"5min":12.978999999999999,"15min":5.8140000000000001},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":64.879000000000005,"5min":64.879000000000005,"15min":64.879000000000005},"last":1.909},{"interface":"front","average":{"1min":13.103999999999999,"5min":11.922000000000001,"15min":5.383},"min":{"1min":1.0700000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":65.153999999999996,"5min":65.153999999999996,"15min":65.153999999999996},"last":1.968}]},{"osd":9,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":9.218,"5min":7.0190000000000001,"15min":3.9079999999999999},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":64.762,"5min":64.762,"15min":64.762},"last":2.0529999999999999},{"interface":"front","average":{"1min":8.3089999999999993,"5min":7.6369999999999996,"15min":4.0359999999999996},"min":{"1min":1.135,"5min":1.1020000000000001,"15min":1.079},"max":{"1min":40.060000000000002,"5min":44.075000000000003,"15min":44.075000000000003},"last":1.8819999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":6.8700000000000001,"5min":6.2960000000000003,"15min":3.472},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":36.637,"5min":37.585000000000001,"15min":37.585000000000001},"last":1.794},{"interface":"front","average":{"1min":7.593,"5min":6.0090000000000003,"15min":3.5579999999999998},"min":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"max":{"1min":35.936999999999998,"5min":35.936999999999998,"15min":35.936999999999998},"last":2.1850000000000001}]}]},{"osd":9,"up_from":17,"seq":73014444177,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321000,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":320704,"kb_avail":94050840,"statfs":{"total":96636764160,"available":96308060160,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":328400896},"hb_peers":[0,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":4.2720000000000002,"5min":2.3250000000000002,"15min":1.8859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":25.289000000000001,"5min":25.289000000000001,"15min":25.289000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":6.9429999999999996,"5min":3.5339999999999998,"15min":2.589},"min":{"1min":0.89100000000000001,"5min":0.63300000000000001,"15min":0.55100000000000005},"max":{"1min":47.780000000000001,"5min":47.780000000000001,"15min":60.811999999999998},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":10.868,"5min":7.7210000000000001,"15min":3.98},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.65400000000000003},"max":{"1min":25.381,"5min":45.261000000000003,"15min":58.615000000000002},"last":0.996},{"interface":"front","average":{"1min":10.151999999999999,"5min":7.1520000000000001,"15min":3.8759999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.68100000000000005},"max":{"1min":28.829999999999998,"5min":44.813000000000002,"15min":60.926000000000002},"last":1.1879999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.726,"5min":2.665,"15min":2.258},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66200000000000003},"max":{"1min":20.359000000000002,"5min":20.359000000000002,"15min":58.482999999999997},"last":1.556},{"interface":"front","average":{"1min":2.056,"5min":2.609,"15min":2.1179999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.61299999999999999},"max":{"1min":18.207999999999998,"5min":18.207999999999998,"15min":58.448999999999998},"last":0.90200000000000002}]},{"osd":4,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":3.528,"15min":2.77},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":20.119,"5min":111.11,"15min":111.11},"last":1.319},{"interface":"front","average":{"1min":2.8180000000000001,"5min":3.9449999999999998,"15min":2.863},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":20.468,"5min":111.654,"15min":111.654},"last":1.2490000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":2.7829999999999999,"15min":2.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.64000000000000001},"max":{"1min":18.385000000000002,"5min":18.385000000000002,"15min":58.762999999999998},"last":1.3009999999999999},{"interface":"front","average":{"1min":2.899,"5min":2.9100000000000001,"15min":2.7120000000000002},"min":{"1min":0.86299999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":20.399000000000001,"5min":20.399000000000001,"15min":61.164999999999999},"last":1.4330000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:02:03 2020","interfaces":[{"interface":"back","average":{"1min":4.4660000000000002,"5min":3.46,"15min":2.7829999999999999},"min":{"1min":0.98799999999999999,"5min":0.749,"15min":0.749},"max":{"1min":24.835999999999999,"5min":24.835999999999999,"15min":60.853999999999999},"last":1.137},{"interface":"front","average":{"1min":4.5389999999999997,"5min":3.5139999999999998,"15min":3.1139999999999999},"min":{"1min":1.1080000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":25.173999999999999,"5min":25.173999999999999,"15min":61.052999999999997},"last":1.5289999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":6.5060000000000002,"5min":5.8630000000000004,"15min":3.7029999999999998},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":50.103999999999999,"5min":50.103999999999999,"15min":62.203000000000003},"last":1.407},{"interface":"front","average":{"1min":6.258,"5min":5.734,"15min":3.5539999999999998},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93500000000000005},"max":{"1min":51.006,"5min":51.006,"15min":63.213999999999999},"last":1.4550000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":7.8310000000000004,"5min":6.0720000000000001,"15min":3.8439999999999999},"min":{"1min":1.099,"5min":1.099,"15min":1.0669999999999999},"max":{"1min":25.058,"5min":28.248999999999999,"15min":61.280999999999999},"last":1.625},{"interface":"front","average":{"1min":8.9629999999999992,"5min":7.4020000000000001,"15min":4.2670000000000003},"min":{"1min":1.4630000000000001,"5min":1.3280000000000001,"15min":1.1020000000000001},"max":{"1min":26.751000000000001,"5min":29.207999999999998,"15min":62.451000000000001},"last":1.708}]},{"osd":10,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":3.2829999999999999,"5min":4.7089999999999996,"15min":3.2999999999999998},"min":{"1min":1.2030000000000001,"5min":1.087,"15min":0.89300000000000002},"max":{"1min":18.513000000000002,"5min":34.356000000000002,"15min":62.869999999999997},"last":1.772},{"interface":"front","average":{"1min":3.4060000000000001,"5min":4.1550000000000002,"15min":3.335},"min":{"1min":1.292,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":20.628,"5min":24.483000000000001,"15min":61.386000000000003},"last":1.74}]},{"osd":11,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":3.1349999999999998,"5min":3.3969999999999998,"15min":2.9620000000000002},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":20.959,"5min":20.959,"15min":62.335000000000001},"last":1.8240000000000001},{"interface":"front","average":{"1min":2.6659999999999999,"5min":3.4350000000000001,"15min":2.9740000000000002},"min":{"1min":1.286,"5min":1.286,"15min":1.085},"max":{"1min":18.706,"5min":18.706,"15min":63.060000000000002},"last":1.5920000000000001}]}]},{"osd":8,"up_from":17,"seq":73014444177,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":332396,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":331712,"kb_avail":94039444,"statfs":{"total":96636764160,"available":96296390656,"internally_reserved":0,"allocated":692224,"data_stored":516906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339673088},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":6.3129999999999997,"5min":4.6769999999999996,"15min":2.5870000000000002},"min":{"1min":0.66400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":31.827999999999999,"5min":39.372999999999998,"15min":39.372999999999998},"last":1.3240000000000001},{"interface":"front","average":{"1min":7.1630000000000003,"5min":4.9470000000000001,"15min":2.6859999999999999},"min":{"1min":0.66900000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":31.295999999999999,"5min":39.444000000000003,"15min":39.444000000000003},"last":1.474}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":20.245999999999999,"5min":15.07,"15min":5.9969999999999999},"min":{"1min":0.71999999999999997,"5min":0.64300000000000002,"15min":0.60999999999999999},"max":{"1min":59.988999999999997,"5min":59.988999999999997,"15min":59.988999999999997},"last":1.157},{"interface":"front","average":{"1min":25.106999999999999,"5min":16.727,"15min":6.6269999999999998},"min":{"1min":0.73899999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":60.848999999999997,"5min":60.848999999999997,"15min":60.848999999999997},"last":1.2609999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":7.9480000000000004,"5min":4.6710000000000003,"15min":2.536},"min":{"1min":0.82699999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":30.893999999999998,"5min":30.893999999999998,"15min":30.893999999999998},"last":1.3680000000000001},{"interface":"front","average":{"1min":10.818,"5min":6.4269999999999996,"15min":3.3100000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":38.066000000000003,"5min":39.195999999999998,"15min":39.195999999999998},"last":1.8140000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":8.6679999999999993,"5min":7.3310000000000004,"15min":3.5739999999999998},"min":{"1min":0.878,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":37.820999999999998,"5min":166.27000000000001,"15min":166.27000000000001},"last":1.675},{"interface":"front","average":{"1min":11.459,"5min":8.6639999999999997,"15min":3.9860000000000002},"min":{"1min":0.79300000000000004,"5min":0.66000000000000003,"15min":0.65700000000000003},"max":{"1min":37.433999999999997,"5min":165.77600000000001,"15min":165.77600000000001},"last":1.502}]},{"osd":5,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":14.531000000000001,"5min":8.3179999999999996,"15min":3.8809999999999998},"min":{"1min":0.68000000000000005,"5min":0.64200000000000002,"15min":0.621},"max":{"1min":37.692999999999998,"5min":38.509999999999998,"15min":38.509999999999998},"last":1.099},{"interface":"front","average":{"1min":10.944000000000001,"5min":6.6020000000000003,"15min":3.27},"min":{"1min":1.0149999999999999,"5min":0.873,"15min":0.69899999999999995},"max":{"1min":31.050000000000001,"5min":39.585999999999999,"15min":39.585999999999999},"last":1.1259999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:02:00 2020","interfaces":[{"interface":"back","average":{"1min":8.7390000000000008,"5min":7.7430000000000003,"15min":3.9510000000000001},"min":{"1min":1.1140000000000001,"5min":0.90500000000000003,"15min":0.73299999999999998},"max":{"1min":31.332999999999998,"5min":39.640999999999998,"15min":39.640999999999998},"last":1.954},{"interface":"front","average":{"1min":10.705,"5min":9.7119999999999997,"15min":4.5739999999999998},"min":{"1min":0.98199999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":31.352,"5min":39.607999999999997,"15min":39.607999999999997},"last":1.397}]},{"osd":7,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":17.698,"5min":11.929,"15min":5.2599999999999998},"min":{"1min":1.0680000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":37.591999999999999,"5min":51.020000000000003,"15min":51.020000000000003},"last":1.6419999999999999},{"interface":"front","average":{"1min":19.245999999999999,"5min":13.065,"15min":5.7999999999999998},"min":{"1min":1.8009999999999999,"5min":1.2729999999999999,"15min":1.216},"max":{"1min":39.064999999999998,"5min":40.451000000000001,"15min":40.451000000000001},"last":2.21}]},{"osd":9,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":16.166,"5min":12.006,"15min":5.4139999999999997},"min":{"1min":1.153,"5min":1.0369999999999999,"15min":0.97199999999999998},"max":{"1min":37.853999999999999,"5min":44.856000000000002,"15min":44.856000000000002},"last":1.603},{"interface":"front","average":{"1min":13.965999999999999,"5min":8.6259999999999994,"15min":4.2400000000000002},"min":{"1min":1.1870000000000001,"5min":1.115,"15min":1.115},"max":{"1min":37.468000000000004,"5min":44.020000000000003,"15min":44.020000000000003},"last":1.9199999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":16.541,"5min":12.448,"15min":5.6200000000000001},"min":{"1min":1.3049999999999999,"5min":1.254,"15min":1.2290000000000001},"max":{"1min":60.356000000000002,"5min":60.356000000000002,"15min":60.356000000000002},"last":2.3460000000000001},{"interface":"front","average":{"1min":17.852,"5min":13.135,"15min":5.8959999999999999},"min":{"1min":1.3169999999999999,"5min":1.1020000000000001,"15min":1.0269999999999999},"max":{"1min":61.103999999999999,"5min":61.103999999999999,"15min":61.103999999999999},"last":1.7410000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":11.356999999999999,"5min":8.3879999999999999,"15min":4.157},"min":{"1min":1.327,"5min":1.2170000000000001,"15min":0.92300000000000004},"max":{"1min":31.670000000000002,"5min":39.838999999999999,"15min":39.838999999999999},"last":1.7929999999999999},{"interface":"front","average":{"1min":16.690999999999999,"5min":9.9670000000000005,"15min":4.7990000000000004},"min":{"1min":1.2330000000000001,"5min":1.212,"15min":1.125},"max":{"1min":60.219999999999999,"5min":60.219999999999999,"15min":60.219999999999999},"last":2.0859999999999999}]}]},{"osd":7,"up_from":17,"seq":73014444178,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":441384,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":441088,"kb_avail":93930456,"statfs":{"total":96636764160,"available":96184786944,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":451674112},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":6.9240000000000004,"5min":3.891,"15min":2.169},"min":{"1min":0.629,"5min":0.629,"15min":0.52600000000000002},"max":{"1min":26.654,"5min":31.739000000000001,"15min":31.739000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":6.8499999999999996,"5min":4.9409999999999998,"15min":2.726},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59299999999999997},"max":{"1min":36.250999999999998,"5min":48.305,"15min":48.305},"last":1.5449999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":4.569,"5min":3.988,"15min":2.2999999999999998},"min":{"1min":0.65800000000000003,"5min":0.64700000000000002,"15min":0.56599999999999995},"max":{"1min":25.803000000000001,"5min":25.803000000000001,"15min":25.803000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":10.651999999999999,"5min":4.944,"15min":2.8610000000000002},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":30.164999999999999,"5min":30.164999999999999,"15min":30.164999999999999},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":18.428000000000001,"5min":11.936,"15min":5.024},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.51100000000000001},"max":{"1min":50.595999999999997,"5min":55.094999999999999,"15min":55.094999999999999},"last":0.997},{"interface":"front","average":{"1min":16.302,"5min":10.824999999999999,"15min":4.6440000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.55700000000000005},"max":{"1min":51.548000000000002,"5min":54.805,"15min":54.805},"last":1.3009999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":12.029,"5min":6.0099999999999998,"15min":3.169},"min":{"1min":0.93300000000000005,"5min":0.755,"15min":0.72499999999999998},"max":{"1min":50.558,"5min":50.558,"15min":50.558},"last":1.4199999999999999},{"interface":"front","average":{"1min":7.2779999999999996,"5min":5.2640000000000002,"15min":2.8479999999999999},"min":{"1min":0.82599999999999996,"5min":0.77500000000000002,"15min":0.73299999999999998},"max":{"1min":26.581,"5min":47.828000000000003,"15min":47.828000000000003},"last":1.4790000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":10.159000000000001,"5min":5.7480000000000002,"15min":3.3420000000000001},"min":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":34.765999999999998,"5min":48.515000000000001,"15min":57.018000000000001},"last":1.077},{"interface":"front","average":{"1min":9.1780000000000008,"5min":5.9589999999999996,"15min":3.4420000000000002},"min":{"1min":1.022,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":36.494999999999997,"5min":48.432000000000002,"15min":65.472999999999999},"last":1.363}]},{"osd":6,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":8.5579999999999998,"5min":7.6340000000000003,"15min":3.7999999999999998},"min":{"1min":1.179,"5min":1.0389999999999999,"15min":0.82499999999999996},"max":{"1min":26.876000000000001,"5min":54.665999999999997,"15min":54.665999999999997},"last":1.657},{"interface":"front","average":{"1min":10.31,"5min":6.7149999999999999,"15min":3.6589999999999998},"min":{"1min":1.175,"5min":1.175,"15min":0.78600000000000003},"max":{"1min":35.107999999999997,"5min":48.649000000000001,"15min":48.649000000000001},"last":1.5189999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":14.885999999999999,"5min":10.472,"15min":4.7439999999999998},"min":{"1min":1.1299999999999999,"5min":0.90600000000000003,"15min":0.85699999999999998},"max":{"1min":60.439999999999998,"5min":60.439999999999998,"15min":60.439999999999998},"last":1.718},{"interface":"front","average":{"1min":15.609,"5min":11.731999999999999,"15min":5.4500000000000002},"min":{"1min":1.3839999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":51.673000000000002,"5min":54.93,"15min":57.436},"last":1.7569999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":12.881,"5min":7.891,"15min":4.1509999999999998},"min":{"1min":1.6399999999999999,"5min":1.1559999999999999,"15min":1.1040000000000001},"max":{"1min":34.847000000000001,"5min":34.847000000000001,"15min":34.847000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":8.3979999999999997,"5min":7.9290000000000003,"15min":4.1020000000000003},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":0.94899999999999995},"max":{"1min":36.601999999999997,"5min":48.563000000000002,"15min":48.563000000000002},"last":1.8680000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":14.691000000000001,"5min":9.1999999999999993,"15min":4.4980000000000002},"min":{"1min":1.26,"5min":1.26,"15min":0.81200000000000006},"max":{"1min":51.338999999999999,"5min":51.338999999999999,"15min":51.338999999999999},"last":1.9379999999999999},{"interface":"front","average":{"1min":17.420999999999999,"5min":9.3740000000000006,"15min":4.6619999999999999},"min":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.0509999999999999},"max":{"1min":83.480999999999995,"5min":83.480999999999995,"15min":83.480999999999995},"last":1.6970000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":9.5690000000000008,"5min":7.4219999999999997,"15min":3.9689999999999999},"min":{"1min":1.2869999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":36.710000000000001,"5min":56.963000000000001,"15min":56.963000000000001},"last":1.9650000000000001},{"interface":"front","average":{"1min":14.188000000000001,"5min":9.3800000000000008,"15min":4.6150000000000002},"min":{"1min":1.3069999999999999,"5min":1.141,"15min":1.141},"max":{"1min":50.468000000000004,"5min":57.441000000000003,"15min":57.441000000000003},"last":1.8480000000000001}]}]},{"osd":6,"up_from":17,"seq":73014444177,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438384,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":438080,"kb_avail":93933456,"statfs":{"total":96636764160,"available":96187858944,"internally_reserved":0,"allocated":303104,"data_stored":136546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":448593920},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":2.2200000000000002,"15min":2.0449999999999999},"min":{"1min":0.67900000000000005,"5min":0.627,"15min":0.627},"max":{"1min":5.4089999999999998,"5min":9.2400000000000002,"15min":54.784999999999997},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.401,"5min":1.796,"15min":1.7070000000000001},"min":{"1min":0.61199999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.4660000000000002,"5min":8.3819999999999997,"15min":55.107999999999997},"last":0.98799999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":12.766,"5min":6.609,"15min":3.4209999999999998},"min":{"1min":0.63600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":30.675999999999998,"5min":52.994999999999997,"15min":52.994999999999997},"last":1.03},{"interface":"front","average":{"1min":14.324,"5min":7.9809999999999999,"15min":4.0709999999999997},"min":{"1min":0.79500000000000004,"5min":0.68600000000000005,"15min":0.68200000000000005},"max":{"1min":38.560000000000002,"5min":54.621000000000002,"15min":54.621000000000002},"last":1.236}]},{"osd":3,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":2.6190000000000002,"15min":2.1600000000000001},"min":{"1min":0.89900000000000002,"5min":0.85299999999999998,"15min":0.66500000000000004},"max":{"1min":5.923,"5min":9.3569999999999993,"15min":14.118},"last":1.325},{"interface":"front","average":{"1min":1.6930000000000001,"5min":2.2639999999999998,"15min":1.738},"min":{"1min":0.82099999999999995,"5min":0.69799999999999995,"15min":0.66400000000000003},"max":{"1min":3.7160000000000002,"5min":8.9909999999999997,"15min":10.124000000000001},"last":1.4159999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:02:00 2020","interfaces":[{"interface":"back","average":{"1min":2.8570000000000002,"5min":2.4289999999999998,"15min":1.95},"min":{"1min":0.998,"5min":0.83399999999999996,"15min":0.81200000000000006},"max":{"1min":18.498999999999999,"5min":18.498999999999999,"15min":18.498999999999999},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":2.1699999999999999,"15min":1.9990000000000001},"min":{"1min":0.752,"5min":0.68600000000000005,"15min":0.68200000000000005},"max":{"1min":2.653,"5min":15.196,"15min":37.557000000000002},"last":1.2010000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":3.0840000000000001,"5min":3.3410000000000002,"15min":2.4329999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":14.662000000000001,"5min":19.068999999999999,"15min":19.068999999999999},"last":1.571},{"interface":"front","average":{"1min":2.044,"5min":2.907,"15min":2.2440000000000002},"min":{"1min":0.91500000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":4.319,"5min":17.635999999999999,"15min":17.635999999999999},"last":1.486}]},{"osd":7,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":5.6280000000000001,"5min":5.625,"15min":3.7919999999999998},"min":{"1min":1.6379999999999999,"5min":1.0800000000000001,"15min":1.03},"max":{"1min":19.704000000000001,"5min":25.669,"15min":63.908999999999999},"last":1.78},{"interface":"front","average":{"1min":5.4390000000000001,"5min":5.5209999999999999,"15min":3.29},"min":{"1min":1.4330000000000001,"5min":1.1319999999999999,"15min":1.01},"max":{"1min":19.827999999999999,"5min":24.888000000000002,"15min":40.161000000000001},"last":1.978}]},{"osd":8,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":7.8620000000000001,"5min":6.1280000000000001,"15min":3.3849999999999998},"min":{"1min":1.056,"5min":0.95099999999999996,"15min":0.91500000000000004},"max":{"1min":37.609999999999999,"5min":46.223999999999997,"15min":46.223999999999997},"last":1.621},{"interface":"front","average":{"1min":8.452,"5min":7.5410000000000004,"15min":4.2919999999999998},"min":{"1min":1.375,"5min":1.254,"15min":0.754},"max":{"1min":38.688000000000002,"5min":46.268000000000001,"15min":46.268000000000001},"last":1.4630000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":4.4509999999999996,"5min":3.71,"15min":2.7389999999999999},"min":{"1min":1.4179999999999999,"5min":1.091,"15min":1.0640000000000001},"max":{"1min":37.701000000000001,"5min":37.701000000000001,"15min":37.701000000000001},"last":1.6539999999999999},{"interface":"front","average":{"1min":5.6539999999999999,"5min":3.9990000000000001,"15min":2.9540000000000002},"min":{"1min":1.028,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":38.225000000000001,"5min":38.225000000000001,"15min":38.225000000000001},"last":1.7969999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":2.7839999999999998,"5min":3.9980000000000002,"15min":3.2349999999999999},"min":{"1min":1.585,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":5.7199999999999998,"5min":54.341000000000001,"15min":54.341000000000001},"last":1.879},{"interface":"front","average":{"1min":3.5640000000000001,"5min":3.6379999999999999,"15min":2.7450000000000001},"min":{"1min":1.486,"5min":1.028,"15min":1.028},"max":{"1min":21.213999999999999,"5min":21.213999999999999,"15min":37.408000000000001},"last":1.8500000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":2.472,"5min":2.9590000000000001,"15min":2.5299999999999998},"min":{"1min":1.1899999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":5.0129999999999999,"5min":15.555999999999999,"15min":15.686},"last":1.9410000000000001},{"interface":"front","average":{"1min":2.8319999999999999,"5min":3.2160000000000002,"15min":2.9159999999999999},"min":{"1min":1.3260000000000001,"5min":1.3140000000000001,"15min":1.006},"max":{"1min":5.798,"5min":15.385,"15min":15.871},"last":1.554}]}]},{"osd":1,"up_from":17,"seq":73014444178,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217256,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":216960,"kb_avail":94154584,"statfs":{"total":96636764160,"available":96414294016,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":222167040},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.851,"15min":1.6259999999999999},"min":{"1min":0.65200000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":9.1549999999999994,"5min":13.398,"15min":13.398},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.7490000000000001,"5min":2.0499999999999998,"15min":1.623},"min":{"1min":0.67200000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":8.8740000000000006,"5min":8.8740000000000006,"15min":8.8740000000000006},"last":1.0029999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":6.8550000000000004,"5min":5.6630000000000003,"15min":2.8740000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.65000000000000002},"max":{"1min":19.198,"5min":28.064,"15min":28.064},"last":1.2889999999999999},{"interface":"front","average":{"1min":8.1270000000000007,"5min":6.077,"15min":3.0569999999999999},"min":{"1min":0.89100000000000001,"5min":0.66800000000000004,"15min":0.64900000000000002},"max":{"1min":19.329000000000001,"5min":28.161000000000001,"15min":28.161000000000001},"last":1.425}]},{"osd":3,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.661,"15min":1.5589999999999999},"min":{"1min":0.72699999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.3940000000000001,"5min":6.266,"15min":8.8119999999999994},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":2.0449999999999999,"15min":1.675},"min":{"1min":0.77000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":3.242,"5min":12.047000000000001,"15min":12.047000000000001},"last":1.046}]},{"osd":4,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.853,"15min":1.657},"min":{"1min":0.83899999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":3.0099999999999998,"5min":8.2989999999999995,"15min":8.8249999999999993},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.9790000000000001,"15min":1.923},"min":{"1min":0.96599999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":3.0859999999999999,"5min":7.6849999999999996,"15min":11.539},"last":1.387}]},{"osd":5,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":2.625,"15min":2.0289999999999999},"min":{"1min":0.72099999999999997,"5min":0.623,"15min":0.623},"max":{"1min":9.3610000000000007,"5min":19.629999999999999,"15min":19.629999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":2.032,"5min":2.7029999999999998,"15min":2.4049999999999998},"min":{"1min":0.96599999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":9.0549999999999997,"5min":20.350000000000001,"15min":84.078999999999994},"last":1.516}]},{"osd":6,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":2.419,"5min":2.6400000000000001,"15min":2.3570000000000002},"min":{"1min":1.1379999999999999,"5min":0.751,"15min":0.751},"max":{"1min":10.849,"5min":12.823,"15min":26.498999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.804,"5min":2.2090000000000001,"15min":2.1269999999999998},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":4.8799999999999999,"5min":11.605,"15min":26.181999999999999},"last":1.55}]},{"osd":7,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":5.4320000000000004,"5min":5.2770000000000001,"15min":3.0579999999999998},"min":{"1min":1.2929999999999999,"5min":1.0620000000000001,"15min":1.024},"max":{"1min":24.317,"5min":30.716000000000001,"15min":30.716000000000001},"last":1.679},{"interface":"front","average":{"1min":5.0460000000000003,"5min":5.1790000000000003,"15min":3.4510000000000001},"min":{"1min":1.131,"5min":1.131,"15min":1.131},"max":{"1min":24.274999999999999,"5min":30.577000000000002,"15min":82.388999999999996},"last":1.5820000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":7.1420000000000003,"5min":6.8369999999999997,"15min":3.6779999999999999},"min":{"1min":1.161,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":19.797999999999998,"5min":40.718000000000004,"15min":40.718000000000004},"last":1.6519999999999999},{"interface":"front","average":{"1min":6.9729999999999999,"5min":6.0739999999999998,"15min":3.407},"min":{"1min":1.381,"5min":1.163,"15min":1.163},"max":{"1min":19.722999999999999,"5min":31.696000000000002,"15min":31.696000000000002},"last":1.841}]},{"osd":9,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":2.9569999999999999,"15min":2.7829999999999999},"min":{"1min":1.3300000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":10.068,"5min":15.138,"15min":84.161000000000001},"last":2.117},{"interface":"front","average":{"1min":2.625,"5min":2.7349999999999999,"15min":2.7669999999999999},"min":{"1min":1.2509999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":10.423,"5min":14.737,"15min":82.528000000000006},"last":1.7649999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":2.8300000000000001,"15min":2.4620000000000002},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":3.6589999999999998,"5min":11.734,"15min":11.734},"last":1.782},{"interface":"front","average":{"1min":1.9530000000000001,"5min":2.7290000000000001,"15min":2.456},"min":{"1min":1.3700000000000001,"5min":1.163,"15min":1.163},"max":{"1min":3.8380000000000001,"5min":9.6880000000000006,"15min":9.6880000000000006},"last":1.9770000000000001}]}]},{"osd":0,"up_from":17,"seq":73014444177,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307112,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":306816,"kb_avail":94064728,"statfs":{"total":96636764160,"available":96322281472,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":314179584},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":3.1859999999999999,"5min":2.6309999999999998,"15min":1.8939999999999999},"min":{"1min":0.71499999999999997,"5min":0.65400000000000003,"15min":0.64800000000000002},"max":{"1min":19.533000000000001,"5min":70.542000000000002,"15min":70.542000000000002},"last":1.073},{"interface":"front","average":{"1min":2.5739999999999998,"5min":2.5099999999999998,"15min":1.804},"min":{"1min":0.63,"5min":0.63,"15min":0.621},"max":{"1min":21.091999999999999,"5min":70.581999999999994,"15min":70.581999999999994},"last":1.415}]},{"osd":2,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":13.818,"5min":6.8499999999999996,"15min":3.4929999999999999},"min":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.57099999999999995},"max":{"1min":38.311999999999998,"5min":56.567,"15min":56.567},"last":1.1319999999999999},{"interface":"front","average":{"1min":13.390000000000001,"5min":7.4059999999999997,"15min":3.714},"min":{"1min":0.879,"5min":0.75600000000000001,"15min":0.59099999999999997},"max":{"1min":39.043999999999997,"5min":54.677,"15min":54.677},"last":1.357}]},{"osd":3,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":4.6280000000000001,"5min":2.5649999999999999,"15min":1.982},"min":{"1min":0.72099999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":21.279,"5min":21.279,"15min":21.279},"last":1.7390000000000001},{"interface":"front","average":{"1min":3.7349999999999999,"5min":2.4119999999999999,"15min":1.905},"min":{"1min":0.876,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":20.106000000000002,"5min":20.106000000000002,"15min":20.106000000000002},"last":1.5029999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":3.645,"5min":3.226,"15min":2.0990000000000002},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":23.719999999999999,"5min":71.278999999999996,"15min":71.278999999999996},"last":1.1020000000000001},{"interface":"front","average":{"1min":4.6100000000000003,"5min":3.4470000000000001,"15min":2.3999999999999999},"min":{"1min":0.73499999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":22.428000000000001,"5min":70.400000000000006,"15min":70.400000000000006},"last":1.321}]},{"osd":5,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":5.7919999999999998,"5min":3.875,"15min":2.6600000000000001},"min":{"1min":1.175,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":25.655999999999999,"5min":28.562999999999999,"15min":28.562999999999999},"last":1.667},{"interface":"front","average":{"1min":4.8280000000000003,"5min":3.581,"15min":2.4550000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.65900000000000003},"max":{"1min":25.934999999999999,"5min":28.533999999999999,"15min":28.533999999999999},"last":1.7110000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":4.6920000000000002,"5min":3.2040000000000002,"15min":2.589},"min":{"1min":0.94099999999999995,"5min":0.92300000000000004,"15min":0.81299999999999994},"max":{"1min":22.518999999999998,"5min":22.518999999999998,"15min":22.518999999999998},"last":1.466},{"interface":"front","average":{"1min":5.6459999999999999,"5min":3.4660000000000002,"15min":2.6509999999999998},"min":{"1min":1.4550000000000001,"5min":0.94199999999999995,"15min":0.89300000000000002},"max":{"1min":24.466000000000001,"5min":24.466000000000001,"15min":24.466000000000001},"last":1.7709999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":7.2160000000000002,"5min":5.7190000000000003,"15min":3.3279999999999998},"min":{"1min":1.137,"5min":1.022,"15min":0.96499999999999997},"max":{"1min":24.622,"5min":72.611000000000004,"15min":72.611000000000004},"last":1.569},{"interface":"front","average":{"1min":6.0819999999999999,"5min":5.7199999999999998,"15min":3.4340000000000002},"min":{"1min":1.258,"5min":1.008,"15min":1.008},"max":{"1min":24.332999999999998,"5min":84.977999999999994,"15min":84.977999999999994},"last":1.601}]},{"osd":8,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":12.308999999999999,"5min":7.7140000000000004,"15min":4.0519999999999996},"min":{"1min":1.264,"5min":1.03,"15min":0.89500000000000002},"max":{"1min":26.106999999999999,"5min":28.295999999999999,"15min":28.295999999999999},"last":1.9950000000000001},{"interface":"front","average":{"1min":10.15,"5min":7.1289999999999996,"15min":3.96},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":23.861999999999998,"5min":26.969999999999999,"15min":26.969999999999999},"last":1.8380000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":6.7400000000000002,"5min":3.7450000000000001,"15min":3.0470000000000002},"min":{"1min":1.444,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":29.007999999999999,"5min":29.007999999999999,"15min":29.007999999999999},"last":1.8879999999999999},{"interface":"front","average":{"1min":4.8419999999999996,"5min":3.4529999999999998,"15min":2.8599999999999999},"min":{"1min":1.3500000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":24.728000000000002,"5min":24.728000000000002,"15min":24.728000000000002},"last":1.8600000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":5.0599999999999996,"5min":3.4039999999999999,"15min":2.778},"min":{"1min":1.341,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":22.533999999999999,"5min":22.533999999999999,"15min":22.533999999999999},"last":1.966},{"interface":"front","average":{"1min":4.6719999999999997,"5min":3.3639999999999999,"15min":2.7109999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":26.276,"5min":26.276,"15min":26.276},"last":2.1160000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444178,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424432,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":424128,"kb_avail":93947408,"statfs":{"total":96636764160,"available":96202145792,"internally_reserved":0,"allocated":303104,"data_stored":136546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":434307072},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":8.6310000000000002,"5min":6.2649999999999997,"15min":3.2989999999999999},"min":{"1min":0.54400000000000004,"5min":0.501,"15min":0.501},"max":{"1min":30.646999999999998,"5min":30.646999999999998,"15min":30.646999999999998},"last":1.224},{"interface":"front","average":{"1min":6.593,"5min":5.9000000000000004,"15min":3.2250000000000001},"min":{"1min":0.72699999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":30.774000000000001,"5min":41.847000000000001,"15min":41.847000000000001},"last":1.54}]},{"osd":1,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":7.335,"5min":5.1829999999999998,"15min":2.7200000000000002},"min":{"1min":0.61299999999999999,"5min":0.60699999999999998,"15min":0.55400000000000005},"max":{"1min":30.812000000000001,"5min":30.812000000000001,"15min":30.812000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":8.1010000000000009,"5min":6.2619999999999996,"15min":3.0680000000000001},"min":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.56299999999999994},"max":{"1min":30.920000000000002,"5min":41.978999999999999,"15min":41.978999999999999},"last":1.25}]},{"osd":3,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":14.132,"5min":7.1820000000000004,"15min":3.4079999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.60199999999999998},"max":{"1min":38.066000000000003,"5min":38.066000000000003,"15min":38.066000000000003},"last":0.92200000000000004},{"interface":"front","average":{"1min":9.5570000000000004,"5min":6.9829999999999997,"15min":3.3199999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":31.047999999999998,"5min":41.701999999999998,"15min":41.701999999999998},"last":1.115}]},{"osd":4,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":12.122999999999999,"5min":7.1669999999999998,"15min":3.5070000000000001},"min":{"1min":1.056,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":37.841000000000001,"5min":37.841000000000001,"15min":37.841000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":11.273,"5min":7.5339999999999998,"15min":3.802},"min":{"1min":1.161,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":31.331,"5min":42.112000000000002,"15min":42.112000000000002},"last":1.9370000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":16.876000000000001,"5min":9.8699999999999992,"15min":4.5970000000000004},"min":{"1min":1.3120000000000001,"5min":1.0509999999999999,"15min":0.80500000000000005},"max":{"1min":52.463000000000001,"5min":52.463000000000001,"15min":52.463000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":10.109999999999999,"5min":6.2510000000000003,"15min":3.1749999999999998},"min":{"1min":0.78900000000000003,"5min":0.70999999999999996,"15min":0.63600000000000001},"max":{"1min":51.593000000000004,"5min":51.593000000000004,"15min":51.593000000000004},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":13.430999999999999,"5min":10.945,"15min":4.9790000000000001},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":0.92800000000000005},"max":{"1min":37.981999999999999,"5min":53.091999999999999,"15min":53.091999999999999},"last":1.738},{"interface":"front","average":{"1min":15.847,"5min":11.459,"15min":5.1289999999999996},"min":{"1min":1.0760000000000001,"5min":1.016,"15min":0.88400000000000001},"max":{"1min":38.770000000000003,"5min":54.316000000000003,"15min":54.316000000000003},"last":1.395}]},{"osd":8,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":11.419,"5min":12.723000000000001,"15min":5.2149999999999999},"min":{"1min":0.78200000000000003,"5min":0.71299999999999997,"15min":0.67100000000000004},"max":{"1min":37.954000000000001,"5min":42.186999999999998,"15min":42.186999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":14.962999999999999,"5min":17.157,"15min":7.1639999999999997},"min":{"1min":1.3799999999999999,"5min":1.1579999999999999,"15min":1.0229999999999999},"max":{"1min":44.622,"5min":53.581000000000003,"15min":53.581000000000003},"last":1.075}]},{"osd":9,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":14.906000000000001,"5min":10.263999999999999,"15min":4.9269999999999996},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":31.460999999999999,"5min":42.360999999999997,"15min":42.360999999999997},"last":1.8140000000000001},{"interface":"front","average":{"1min":11.281000000000001,"5min":7.5279999999999996,"15min":3.6230000000000002},"min":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.82199999999999995},"max":{"1min":37.781999999999996,"5min":37.781999999999996,"15min":37.781999999999996},"last":1.1910000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":13.02,"5min":9.7680000000000007,"15min":4.8159999999999998},"min":{"1min":1.345,"5min":1.1619999999999999,"15min":1.008},"max":{"1min":31.437000000000001,"5min":32.781999999999996,"15min":32.781999999999996},"last":1.458},{"interface":"front","average":{"1min":14.052,"5min":10.194000000000001,"15min":4.976},"min":{"1min":1.3069999999999999,"5min":1.1539999999999999,"15min":0.99099999999999999},"max":{"1min":35.707999999999998,"5min":42.966999999999999,"15min":42.966999999999999},"last":1.679}]},{"osd":11,"last update":"Fri Nov 20 12:01:52 2020","interfaces":[{"interface":"back","average":{"1min":5.7999999999999998,"5min":4.9690000000000003,"15min":2.7490000000000001},"min":{"1min":0.95699999999999996,"5min":0.93000000000000005,"15min":0.80400000000000005},"max":{"1min":32.301000000000002,"5min":32.301000000000002,"15min":32.301000000000002},"last":1.046},{"interface":"front","average":{"1min":15.843,"5min":9.5020000000000007,"15min":4.6040000000000001},"min":{"1min":1.286,"5min":1.1890000000000001,"15min":1.081},"max":{"1min":44.747,"5min":44.747,"15min":44.747},"last":1.569}]}]},{"osd":3,"up_from":17,"seq":73014444178,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123492,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":122816,"kb_avail":94248348,"statfs":{"total":96636764160,"available":96510308352,"internally_reserved":0,"allocated":684032,"data_stored":516746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":125763584},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":4.2210000000000001,"5min":2.4359999999999999,"15min":1.8049999999999999},"min":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.58799999999999997},"max":{"1min":22.856000000000002,"5min":22.856000000000002,"15min":22.856000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":3.6840000000000002,"5min":2.1819999999999999,"15min":1.7370000000000001},"min":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.61199999999999999},"max":{"1min":19.210999999999999,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":9.6300000000000008,"5min":7.7460000000000004,"15min":3.754},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":28.315000000000001,"5min":47.859999999999999,"15min":47.859999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":9.2880000000000003,"5min":7.1609999999999996,"15min":3.5539999999999998},"min":{"1min":0.81200000000000006,"5min":0.73999999999999999,"15min":0.71699999999999997},"max":{"1min":28.369,"5min":51.231999999999999,"15min":51.231999999999999},"last":1.3100000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":2.4809999999999999,"15min":1.756},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.0270000000000001,"5min":47.366999999999997,"15min":47.366999999999997},"last":1.093},{"interface":"front","average":{"1min":1.4370000000000001,"5min":2.766,"15min":2.0600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.6469999999999998,"5min":47.561999999999998,"15min":47.561999999999998},"last":1.3720000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.9180000000000001,"5min":3.488,"15min":2.4460000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":16.207999999999998,"5min":48.454999999999998,"15min":48.454999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":3.1560000000000001,"5min":3.645,"15min":2.3780000000000001},"min":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":16.050999999999998,"5min":47.738,"15min":47.738},"last":1.409}]},{"osd":6,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":3.2589999999999999,"5min":3.3010000000000002,"15min":2.2930000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.64300000000000002},"max":{"1min":19.969000000000001,"5min":51.186,"15min":51.186},"last":0.84099999999999997},{"interface":"front","average":{"1min":4.2370000000000001,"5min":4.1479999999999997,"15min":2.8809999999999998},"min":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":0.95199999999999996},"max":{"1min":20.757000000000001,"5min":48.158999999999999,"15min":48.158999999999999},"last":1.518}]},{"osd":7,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":5.54,"5min":6.0970000000000004,"15min":3.4199999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":17.635999999999999,"5min":60.584000000000003,"15min":60.584000000000003},"last":1.6859999999999999},{"interface":"front","average":{"1min":4.0179999999999998,"5min":5.923,"15min":3.306},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":14.035,"5min":60.103000000000002,"15min":60.103000000000002},"last":1.7729999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":12.840999999999999,"5min":9.0090000000000003,"15min":4.492},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":49.238,"5min":54.895000000000003,"15min":54.895000000000003},"last":1.637},{"interface":"front","average":{"1min":13.085000000000001,"5min":9.4719999999999995,"15min":4.5270000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.872},"max":{"1min":50.107999999999997,"5min":55.241,"15min":55.241},"last":1.2270000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":3.718,"5min":3.8130000000000002,"15min":2.847},"min":{"1min":1.3580000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":12.048,"5min":48.261000000000003,"15min":48.261000000000003},"last":1.8200000000000001},{"interface":"front","average":{"1min":3.5750000000000002,"5min":3.9809999999999999,"15min":3.0139999999999998},"min":{"1min":1.353,"5min":1.085,"15min":1.085},"max":{"1min":12.147,"5min":50.363999999999997,"15min":50.363999999999997},"last":2.0299999999999998}]},{"osd":10,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":3.7810000000000001,"15min":2.6779999999999999},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":0.97899999999999998},"max":{"1min":3.2309999999999999,"5min":54.128999999999998,"15min":54.128999999999998},"last":1.556},{"interface":"front","average":{"1min":2.956,"5min":4.3419999999999996,"15min":3.0139999999999998},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":15.356999999999999,"5min":51.743000000000002,"15min":51.743000000000002},"last":1.962}]},{"osd":11,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.1339999999999999,"5min":3.2919999999999998,"15min":2.6930000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":4.835,"5min":48.630000000000003,"15min":48.630000000000003},"last":1.915},{"interface":"front","average":{"1min":1.8540000000000001,"5min":3.2210000000000001,"15min":2.5419999999999998},"min":{"1min":1.157,"5min":1.117,"15min":1.073},"max":{"1min":3.4409999999999998,"5min":48.878,"15min":48.878},"last":1.6679999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444179,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120624,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":120320,"kb_avail":94251216,"statfs":{"total":96636764160,"available":96513245184,"internally_reserved":0,"allocated":303104,"data_stored":138126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":123207680},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":4.609,"5min":3.2589999999999999,"15min":2.056},"min":{"1min":0.65400000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":31.465,"5min":102.258,"15min":102.258},"last":1.0309999999999999},{"interface":"front","average":{"1min":5.1150000000000002,"5min":3.4329999999999998,"15min":2.008},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":31.693999999999999,"5min":102.45,"15min":102.45},"last":1.228}]},{"osd":1,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":1.958,"5min":2.1150000000000002,"15min":1.474},"min":{"1min":0.63400000000000001,"5min":0.60599999999999998,"15min":0.55900000000000005},"max":{"1min":6.5650000000000004,"5min":47.159999999999997,"15min":47.159999999999997},"last":0.81299999999999994},{"interface":"front","average":{"1min":2.206,"5min":2.2719999999999998,"15min":1.671},"min":{"1min":0.76000000000000001,"5min":0.622,"15min":0.57499999999999996},"max":{"1min":6.9130000000000003,"5min":48.533000000000001,"15min":48.533000000000001},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.897,"15min":1.6299999999999999},"min":{"1min":0.73999999999999999,"5min":0.68899999999999995,"15min":0.60799999999999998},"max":{"1min":7.5789999999999997,"5min":12.468999999999999,"15min":14.170999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":2.2450000000000001,"5min":2.1669999999999998,"15min":1.8660000000000001},"min":{"1min":0.97299999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":6.6870000000000003,"5min":12.577999999999999,"15min":41.307000000000002},"last":1.1000000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.3090000000000002,"5min":2.5329999999999999,"15min":2.0990000000000002},"min":{"1min":0.86699999999999999,"5min":0.751,"15min":0.751},"max":{"1min":7.2670000000000003,"5min":13.441000000000001,"15min":19.434999999999999},"last":1.369},{"interface":"front","average":{"1min":1.8089999999999999,"5min":2.4169999999999998,"15min":2.004},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.67900000000000005},"max":{"1min":7.7140000000000004,"5min":17.093,"15min":17.093},"last":1.0660000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.8399999999999999,"5min":3.7930000000000001,"15min":2.5129999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":7.5199999999999996,"5min":105.96899999999999,"15min":105.96899999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":3.629,"5min":3.9929999999999999,"15min":2.6970000000000001},"min":{"1min":0.91500000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":14.788,"5min":100.04600000000001,"15min":100.04600000000001},"last":1.4570000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":5.5060000000000002,"5min":7.133,"15min":3.9289999999999998},"min":{"1min":1.4870000000000001,"5min":1.026,"15min":1.0069999999999999},"max":{"1min":21.757000000000001,"5min":161.50700000000001,"15min":161.50700000000001},"last":1.528},{"interface":"front","average":{"1min":4.8120000000000003,"5min":6.4889999999999999,"15min":3.5819999999999999},"min":{"1min":0.96099999999999997,"5min":0.94499999999999995,"15min":0.93300000000000005},"max":{"1min":21.68,"5min":163.98400000000001,"15min":163.98400000000001},"last":1.3440000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":6.7649999999999997,"5min":6.3460000000000001,"15min":3.8380000000000001},"min":{"1min":1.3700000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":21.48,"5min":62.640000000000001,"15min":69.906999999999996},"last":1.2869999999999999},{"interface":"front","average":{"1min":7.8380000000000001,"5min":6.8159999999999998,"15min":4.1959999999999997},"min":{"1min":1.3280000000000001,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":23.038,"5min":31.582000000000001,"15min":69.778999999999996},"last":1.6910000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":3.206,"5min":3.8180000000000001,"15min":2.6909999999999998},"min":{"1min":1.165,"5min":1.0009999999999999,"15min":0.94599999999999995},"max":{"1min":7.3170000000000002,"5min":101.361,"15min":101.361},"last":1.6140000000000001},{"interface":"front","average":{"1min":3.3730000000000002,"5min":4.1959999999999997,"15min":3.012},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":10.122999999999999,"5min":100.304,"15min":100.304},"last":1.853}]},{"osd":10,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":4.0830000000000002,"5min":3.895,"15min":2.7789999999999999},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":35.225999999999999,"5min":35.225999999999999,"15min":42.716000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":4.6609999999999996,"5min":3.9500000000000002,"15min":2.8260000000000001},"min":{"1min":1.2509999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"max":{"1min":35.728000000000002,"5min":35.728000000000002,"15min":41.594000000000001},"last":1.776}]},{"osd":11,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.4940000000000002,"5min":2.3260000000000001,"15min":2.141},"min":{"1min":1.0449999999999999,"5min":1.0149999999999999,"15min":0.999},"max":{"1min":7.9569999999999999,"5min":7.9569999999999999,"15min":18.399999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":2.9540000000000002,"5min":2.5139999999999998,"15min":2.21},"min":{"1min":1.2370000000000001,"5min":1.0980000000000001,"15min":1.056},"max":{"1min":7.4320000000000004,"5min":8.673,"15min":12.753},"last":1.9299999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444178,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236264,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":235968,"kb_avail":94135576,"statfs":{"total":96636764160,"available":96394829824,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":241631232},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":3.7589999999999999,"15min":2.3450000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":14.265000000000001,"5min":92.478999999999999,"15min":92.478999999999999},"last":1.006},{"interface":"front","average":{"1min":2.1280000000000001,"5min":3.6440000000000001,"15min":2.27},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.50900000000000001},"max":{"1min":13.882999999999999,"5min":92.281000000000006,"15min":92.281000000000006},"last":1.405}]},{"osd":1,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":2.1970000000000001,"5min":2.1779999999999999,"15min":1.708},"min":{"1min":0.65700000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":14.005000000000001,"5min":23.925999999999998,"15min":23.925999999999998},"last":1.714},{"interface":"front","average":{"1min":1.8149999999999999,"5min":2.1920000000000002,"15min":1.6639999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":13.313000000000001,"5min":23.872,"15min":23.872},"last":1.585}]},{"osd":2,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":9.8480000000000008,"5min":7.782,"15min":3.585},"min":{"1min":0.94699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":42.661999999999999,"5min":42.661999999999999,"15min":42.661999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":9.7739999999999991,"5min":6.3730000000000002,"15min":3.0910000000000002},"min":{"1min":0.97199999999999998,"5min":0.62,"15min":0.58499999999999996},"max":{"1min":39.201000000000001,"5min":40.118000000000002,"15min":40.118000000000002},"last":0.97199999999999998}]},{"osd":4,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":1.8740000000000001,"5min":2.3109999999999999,"15min":1.7250000000000001},"min":{"1min":0.67900000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":13.679,"5min":24.416,"15min":24.416},"last":1.2150000000000001},{"interface":"front","average":{"1min":2.2229999999999999,"5min":2.7639999999999998,"15min":2.1230000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":14.544,"5min":25.056999999999999,"15min":25.056999999999999},"last":1.466}]},{"osd":6,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":4.0789999999999997,"5min":4.5819999999999999,"15min":2.8679999999999999},"min":{"1min":0.73299999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":21.658000000000001,"5min":92.433000000000007,"15min":92.433000000000007},"last":1.266},{"interface":"front","average":{"1min":3.6080000000000001,"5min":4.2329999999999997,"15min":2.6349999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.63800000000000001},"max":{"1min":21.619,"5min":93.030000000000001,"15min":93.030000000000001},"last":1.083}]},{"osd":7,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":6.8129999999999997,"5min":4.5359999999999996,"15min":2.7029999999999998},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":23.489000000000001,"5min":28.178999999999998,"15min":28.178999999999998},"last":1.3320000000000001},{"interface":"front","average":{"1min":6.9429999999999996,"5min":5.1509999999999998,"15min":2.9910000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":26.337,"5min":27.550000000000001,"15min":27.550000000000001},"last":1.3720000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":10.869,"5min":7.9370000000000003,"15min":3.879},"min":{"1min":1.024,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":33.412999999999997,"5min":46.585999999999999,"15min":46.585999999999999},"last":1.5529999999999999},{"interface":"front","average":{"1min":8.9619999999999997,"5min":6.8280000000000003,"15min":3.4790000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.77700000000000002},"max":{"1min":32.5,"5min":32.5,"15min":32.5},"last":1.4890000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":3.2469999999999999,"5min":4.8550000000000004,"15min":3.3180000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":14.997999999999999,"5min":93.725999999999999,"15min":93.725999999999999},"last":1.6970000000000001},{"interface":"front","average":{"1min":3.7040000000000002,"5min":5.0030000000000001,"15min":3.3199999999999998},"min":{"1min":1.079,"5min":1.0600000000000001,"15min":0.96399999999999997},"max":{"1min":14.153,"5min":93.593000000000004,"15min":93.593000000000004},"last":1.853}]},{"osd":10,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":3.0030000000000001,"5min":3.9590000000000001,"15min":2.7650000000000001},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":14.926,"5min":46.350999999999999,"15min":46.350999999999999},"last":1.772},{"interface":"front","average":{"1min":3.036,"5min":4.1139999999999999,"15min":2.7309999999999999},"min":{"1min":0.99299999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":15.037000000000001,"5min":46.466000000000001,"15min":46.466000000000001},"last":1.9770000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":2.899,"5min":3.206,"15min":2.4540000000000002},"min":{"1min":0.89800000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":13.801,"5min":28.012,"15min":28.012},"last":1.6699999999999999},{"interface":"front","average":{"1min":2.6920000000000002,"5min":3.601,"15min":2.7050000000000001},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":15.065,"5min":27.809000000000001,"15min":27.809000000000001},"last":1.6020000000000001}]}]}]}} 2020-11-20T12:02:28.826 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:02:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.933+0000 7ff808e56700 1 Processor -- start 2020-11-20T12:02:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.933+0000 7ff808e56700 1 -- start start 2020-11-20T12:02:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff808e56700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff8040bdbe0 0x7ff8040bdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff808e56700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff80409ca10 0x7ff80409e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff808e56700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8041512d0 con 0x7ff80409e560 2020-11-20T12:02:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff808e56700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff804151570 con 0x7ff8040bdbe0 2020-11-20T12:02:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff808e56700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff804151810 con 0x7ff80409ca10 2020-11-20T12:02:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff803fff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff80409e560 0x7ff804150610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55908/0 (socket says 172.21.15.164:55908) 2020-11-20T12:02:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff803fff700 1 -- 172.21.15.164:0/2567379095 learned_addr learned my addr 172.21.15.164:0/2567379095 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff802ffd700 1 --2- 172.21.15.164:0/2567379095 >> v2:172.21.15.188:3300/0 conn(0x7ff80409ca10 0x7ff80409e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8037fe700 1 --2- 172.21.15.164:0/2567379095 >> v2:172.21.15.36:3300/0 conn(0x7ff8040bdbe0 0x7ff8040bdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129947808 0 0) 0x7ff8041512d0 con 0x7ff80409e560 2020-11-20T12:02:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7f0003280 con 0x7ff80409e560 2020-11-20T12:02:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 569789560 0 0) 0x7ff7f0003280 con 0x7ff80409e560 2020-11-20T12:02:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 >> v2:172.21.15.188:3300/0 conn(0x7ff80409ca10 msgr2=0x7ff80409e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 --2- 172.21.15.164:0/2567379095 >> v2:172.21.15.188:3300/0 conn(0x7ff80409ca10 0x7ff80409e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 >> v2:172.21.15.36:3300/0 conn(0x7ff8040bdbe0 msgr2=0x7ff8040bdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 --2- 172.21.15.164:0/2567379095 >> v2:172.21.15.36:3300/0 conn(0x7ff8040bdbe0 0x7ff8040bdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804151ab0 con 0x7ff80409e560 2020-11-20T12:02:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7ff7fc0018a0 con 0x7ff80409e560 2020-11-20T12:02:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 >> v1:172.21.15.164:6789/0 conn(0x7ff80409e560 legacy=0x7ff804150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f00037c0 0x7ff7f0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7f0004520 0x7ff7f00049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f0004e90 0x7ff7f000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff804151570 con 0x7ff7f0004520 2020-11-20T12:02:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff804151810 con 0x7ff7f0004e90 2020-11-20T12:02:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.934+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00053f0 con 0x7ff7f00037c0 2020-11-20T12:02:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.935+0000 7ff803fff700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f0004e90 0x7ff7f000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.935+0000 7ff8037fe700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f00037c0 0x7ff7f0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.935+0000 7ff802ffd700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7f0004520 0x7ff7f00049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.935+0000 7ff803fff700 1 -- 172.21.15.164:0/2567379095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f00037c0 msgr2=0x7ff7f0003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.935+0000 7ff803fff700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f00037c0 0x7ff7f0003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.935+0000 7ff803fff700 1 -- 172.21.15.164:0/2567379095 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7f0004520 msgr2=0x7ff7f00049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.935+0000 7ff803fff700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7f0004520 0x7ff7f00049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.935+0000 7ff803fff700 1 -- 172.21.15.164:0/2567379095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0003280 con 0x7ff7f0004e90 2020-11-20T12:02:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.935+0000 7ff803fff700 1 -- 172.21.15.164:0/2567379095 reap_dead start 2020-11-20T12:02:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.935+0000 7ff803fff700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f0004e90 0x7ff7f000b770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7ff7fc00c840 tx=0x7ff8040815a0).ready entity=mon.1 client_cookie=40013837a01feecb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.948+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc005bc0 con 0x7ff7f0004e90 2020-11-20T12:02:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.948+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc005d20 con 0x7ff7f0004e90 2020-11-20T12:02:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.948+0000 7ff8027fc700 1 -- 172.21.15.164:0/2567379095 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc0072e0 con 0x7ff7f0004e90 2020-11-20T12:02:28.953 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.948+0000 7ff808e56700 1 -- 172.21.15.164:0/2567379095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f0004e90 msgr2=0x7ff7f000b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.953 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.948+0000 7ff808e56700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f0004e90 0x7ff7f000b770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7ff7fc00c840 tx=0x7ff8040815a0).stop 2020-11-20T12:02:28.953 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.948+0000 7ff808e56700 1 -- 172.21.15.164:0/2567379095 shutdown_connections 2020-11-20T12:02:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.948+0000 7ff808e56700 1 --2- 172.21.15.164:0/2567379095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f0004e90 0x7ff7f000b770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.948+0000 7ff808e56700 1 -- 172.21.15.164:0/2567379095 >> 172.21.15.164:0/2567379095 conn(0x7ff80407ffb0 msgr2=0x7ff8040803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.948+0000 7ff808e56700 1 -- 172.21.15.164:0/2567379095 shutdown_connections 2020-11-20T12:02:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.948+0000 7ff808e56700 1 -- 172.21.15.164:0/2567379095 wait complete. 2020-11-20T12:02:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.949+0000 7ff808e56700 1 Processor -- start 2020-11-20T12:02:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.949+0000 7ff808e56700 1 -- start start 2020-11-20T12:02:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.950+0000 7ff808e56700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f0004e90 0x7ff804154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.950+0000 7ff808e56700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff804156bd0 0x7ff8040bea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.950+0000 7ff808e56700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff80414bef0 0x7ff8041606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.950+0000 7ff808e56700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040bef10 con 0x7ff804156bd0 2020-11-20T12:02:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.950+0000 7ff808e56700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8041558e0 con 0x7ff80414bef0 2020-11-20T12:02:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.950+0000 7ff808e56700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff804155b80 con 0x7ff7f0004e90 2020-11-20T12:02:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.950+0000 7ff803fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff80414bef0 0x7ff8041606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.950+0000 7ff803fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff80414bef0 0x7ff8041606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46180/0 (socket says 172.21.15.164:46180) 2020-11-20T12:02:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.950+0000 7ff803fff700 1 -- 172.21.15.164:0/3737987115 learned_addr learned my addr 172.21.15.164:0/3737987115 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff802ffd700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff804156bd0 0x7ff8040bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff8037fe700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f0004e90 0x7ff804154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff803fff700 1 -- 172.21.15.164:0/3737987115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f0004e90 msgr2=0x7ff804154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff803fff700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f0004e90 0x7ff804154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff803fff700 1 -- 172.21.15.164:0/3737987115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff804156bd0 msgr2=0x7ff8040bea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff803fff700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff804156bd0 0x7ff8040bea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff803fff700 1 -- 172.21.15.164:0/3737987115 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804155e20 con 0x7ff80414bef0 2020-11-20T12:02:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff803fff700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff80414bef0 0x7ff8041606b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ff7fc007d00 tx=0x7ff7fc010000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff7e37fe700 1 -- 172.21.15.164:0/3737987115 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc017070 con 0x7ff80414bef0 2020-11-20T12:02:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff7e37fe700 1 -- 172.21.15.164:0/3737987115 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc007920 con 0x7ff80414bef0 2020-11-20T12:02:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff808e56700 1 -- 172.21.15.164:0/3737987115 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff804160210 con 0x7ff80414bef0 2020-11-20T12:02:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff7e37fe700 1 -- 172.21.15.164:0/3737987115 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc004d00 con 0x7ff80414bef0 2020-11-20T12:02:28.961 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.951+0000 7ff808e56700 1 -- 172.21.15.164:0/3737987115 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff804152f10 con 0x7ff80414bef0 2020-11-20T12:02:28.961 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.952+0000 7ff808e56700 1 -- 172.21.15.164:0/3737987115 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80405cf90 con 0x7ff80414bef0 2020-11-20T12:02:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.959+0000 7ff7e37fe700 1 -- 172.21.15.164:0/3737987115 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff7fc025030 con 0x7ff80414bef0 2020-11-20T12:02:28.964 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.959+0000 7ff7e37fe700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff7dc080670 0x7ff7dc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:28.964 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.960+0000 7ff8037fe700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff7dc080670 0x7ff7dc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:28.964 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.960+0000 7ff7e37fe700 1 -- 172.21.15.164:0/3737987115 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff7fc07c950 con 0x7ff80414bef0 2020-11-20T12:02:28.964 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.960+0000 7ff8037fe700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff7dc080670 0x7ff7dc082b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff7f8006ce0 tx=0x7ff7f8008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:28.977 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:28.973+0000 7ff7e37fe700 1 -- 172.21.15.164:0/3737987115 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff7fc078cf0 con 0x7ff80414bef0 2020-11-20T12:02:29.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.113+0000 7ff808e56700 1 -- 172.21.15.164:0/3737987115 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8041603a0 con 0x7ff80414bef0 2020-11-20T12:02:29.117 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.114+0000 7ff7e37fe700 1 -- 172.21.15.164:0/3737987115 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7ff7fc023070 con 0x7ff80414bef0 2020-11-20T12:02:29.118 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T12:02:29.118 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":28,"fsid":"8d9b76f1-9267-4076-877e-b8d77372c9f3","created":"2020-11-20T11:50:18.824611+0000","modified":"2020-11-20T11:50:39.612589+0000","last_up_change":"2020-11-20T11:50:27.107133+0000","last_in_change":"2020-11-20T11:50:27.107133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:50:22.130897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:50:32.016548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:50:34.615204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:50:37.302647+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"050edf6c-5162-4282-aee5-16d0ec6a7b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":23229},{"type":"v1","addr":"172.21.15.164:6803","nonce":23229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":23229},{"type":"v1","addr":"172.21.15.164:6805","nonce":23229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":23229},{"type":"v1","addr":"172.21.15.164:6809","nonce":23229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":23229},{"type":"v1","addr":"172.21.15.164:6807","nonce":23229}]},"public_addr":"172.21.15.164:6803/23229","cluster_addr":"172.21.15.164:6805/23229","heartbeat_back_addr":"172.21.15.164:6809/23229","heartbeat_front_addr":"172.21.15.164:6807/23229","state":["exists","up"]},{"osd":1,"uuid":"c831cefc-812f-458c-af07-085f0dd85a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":23019},{"type":"v1","addr":"172.21.15.36:6801","nonce":23019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":23019},{"type":"v1","addr":"172.21.15.36:6803","nonce":23019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":23019},{"type":"v1","addr":"172.21.15.36:6807","nonce":23019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":23019},{"type":"v1","addr":"172.21.15.36:6805","nonce":23019}]},"public_addr":"172.21.15.36:6801/23019","cluster_addr":"172.21.15.36:6803/23019","heartbeat_back_addr":"172.21.15.36:6807/23019","heartbeat_front_addr":"172.21.15.36:6805/23019","state":["exists","up"]},{"osd":2,"uuid":"8478d740-989b-4d1a-8e40-6dff71e4b289","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":23468},{"type":"v1","addr":"172.21.15.188:6801","nonce":23468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":23468},{"type":"v1","addr":"172.21.15.188:6803","nonce":23468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":23468},{"type":"v1","addr":"172.21.15.188:6807","nonce":23468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":23468},{"type":"v1","addr":"172.21.15.188:6805","nonce":23468}]},"public_addr":"172.21.15.188:6801/23468","cluster_addr":"172.21.15.188:6803/23468","heartbeat_back_addr":"172.21.15.188:6807/23468","heartbeat_front_addr":"172.21.15.188:6805/23468","state":["exists","up"]},{"osd":3,"uuid":"4891bc60-773c-4fdf-991a-608f802e782f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":23230},{"type":"v1","addr":"172.21.15.164:6811","nonce":23230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6813","nonce":23230},{"type":"v1","addr":"172.21.15.164:6815","nonce":23230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6821","nonce":23230},{"type":"v1","addr":"172.21.15.164:6823","nonce":23230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":23230},{"type":"v1","addr":"172.21.15.164:6819","nonce":23230}]},"public_addr":"172.21.15.164:6811/23230","cluster_addr":"172.21.15.164:6815/23230","heartbeat_back_addr":"172.21.15.164:6823/23230","heartbeat_front_addr":"172.21.15.164:6819/23230","state":["exists","up"]},{"osd":4,"uuid":"2d95ba05-a3a3-443a-8653-cfdad980c161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6824","nonce":23020},{"type":"v1","addr":"172.21.15.36:6825","nonce":23020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":23020},{"type":"v1","addr":"172.21.15.36:6827","nonce":23020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":23020},{"type":"v1","addr":"172.21.15.36:6831","nonce":23020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":23020},{"type":"v1","addr":"172.21.15.36:6829","nonce":23020}]},"public_addr":"172.21.15.36:6825/23020","cluster_addr":"172.21.15.36:6827/23020","heartbeat_back_addr":"172.21.15.36:6831/23020","heartbeat_front_addr":"172.21.15.36:6829/23020","state":["exists","up"]},{"osd":5,"uuid":"f5e0530b-a407-45a4-8cc4-2ec32b722510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":23469},{"type":"v1","addr":"172.21.15.188:6809","nonce":23469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":23469},{"type":"v1","addr":"172.21.15.188:6811","nonce":23469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":23469},{"type":"v1","addr":"172.21.15.188:6816","nonce":23469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":23469},{"type":"v1","addr":"172.21.15.188:6813","nonce":23469}]},"public_addr":"172.21.15.188:6809/23469","cluster_addr":"172.21.15.188:6811/23469","heartbeat_back_addr":"172.21.15.188:6816/23469","heartbeat_front_addr":"172.21.15.188:6813/23469","state":["exists","up"]},{"osd":6,"uuid":"84225f1e-f6bb-4587-994b-0db5e9c2412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":23231},{"type":"v1","addr":"172.21.15.164:6814","nonce":23231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":23231},{"type":"v1","addr":"172.21.15.164:6818","nonce":23231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":23231},{"type":"v1","addr":"172.21.15.164:6825","nonce":23231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":23231},{"type":"v1","addr":"172.21.15.164:6822","nonce":23231}]},"public_addr":"172.21.15.164:6814/23231","cluster_addr":"172.21.15.164:6818/23231","heartbeat_back_addr":"172.21.15.164:6825/23231","heartbeat_front_addr":"172.21.15.164:6822/23231","state":["exists","up"]},{"osd":7,"uuid":"3bbb4a5c-84fe-4339-8b91-a3a26712c5c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":23021},{"type":"v1","addr":"172.21.15.36:6809","nonce":23021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":23021},{"type":"v1","addr":"172.21.15.36:6811","nonce":23021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":23021},{"type":"v1","addr":"172.21.15.36:6816","nonce":23021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6812","nonce":23021},{"type":"v1","addr":"172.21.15.36:6813","nonce":23021}]},"public_addr":"172.21.15.36:6809/23021","cluster_addr":"172.21.15.36:6811/23021","heartbeat_back_addr":"172.21.15.36:6816/23021","heartbeat_front_addr":"172.21.15.36:6813/23021","state":["exists","up"]},{"osd":8,"uuid":"ca3bb3e9-1e26-4577-8028-e1088664758d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":23470},{"type":"v1","addr":"172.21.15.188:6825","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":23470},{"type":"v1","addr":"172.21.15.188:6827","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":23470},{"type":"v1","addr":"172.21.15.188:6831","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":23470},{"type":"v1","addr":"172.21.15.188:6829","nonce":23470}]},"public_addr":"172.21.15.188:6825/23470","cluster_addr":"172.21.15.188:6827/23470","heartbeat_back_addr":"172.21.15.188:6831/23470","heartbeat_front_addr":"172.21.15.188:6829/23470","state":["exists","up"]},{"osd":9,"uuid":"fdb23d21-88fe-4715-8197-4fe0bded6bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":23232},{"type":"v1","addr":"172.21.15.164:6827","nonce":23232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":23232},{"type":"v1","addr":"172.21.15.164:6829","nonce":23232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":23232},{"type":"v1","addr":"172.21.15.164:6833","nonce":23232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":23232},{"type":"v1","addr":"172.21.15.164:6831","nonce":23232}]},"public_addr":"172.21.15.164:6827/23232","cluster_addr":"172.21.15.164:6829/23232","heartbeat_back_addr":"172.21.15.164:6833/23232","heartbeat_front_addr":"172.21.15.164:6831/23232","state":["exists","up"]},{"osd":10,"uuid":"106c212d-2332-4f3a-86d6-212b125e24ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":23022},{"type":"v1","addr":"172.21.15.36:6817","nonce":23022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":23022},{"type":"v1","addr":"172.21.15.36:6819","nonce":23022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":23022},{"type":"v1","addr":"172.21.15.36:6823","nonce":23022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6820","nonce":23022},{"type":"v1","addr":"172.21.15.36:6821","nonce":23022}]},"public_addr":"172.21.15.36:6817/23022","cluster_addr":"172.21.15.36:6819/23022","heartbeat_back_addr":"172.21.15.36:6823/23022","heartbeat_front_addr":"172.21.15.36:6821/23022","state":["exists","up"]},{"osd":11,"uuid":"428273c5-731b-4472-98e6-62b48a587419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":23471},{"type":"v1","addr":"172.21.15.188:6817","nonce":23471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":23471},{"type":"v1","addr":"172.21.15.188:6819","nonce":23471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":23471},{"type":"v1","addr":"172.21.15.188:6823","nonce":23471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":23471},{"type":"v1","addr":"172.21.15.188:6821","nonce":23471}]},"public_addr":"172.21.15.188:6817/23471","cluster_addr":"172.21.15.188:6819/23471","heartbeat_back_addr":"172.21.15.188:6823/23471","heartbeat_front_addr":"172.21.15.188:6821/23471","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.299026+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.372663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.292057+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.297990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.439638+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.335419+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.306683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.326325+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.449176+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.350130+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.366790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:50:25.329686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:02:29.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.115+0000 7ff808e56700 1 -- 172.21.15.164:0/3737987115 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff7dc080670 msgr2=0x7ff7dc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:29.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.115+0000 7ff808e56700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff7dc080670 0x7ff7dc082b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff7f8006ce0 tx=0x7ff7f8008040).stop 2020-11-20T12:02:29.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.115+0000 7ff808e56700 1 -- 172.21.15.164:0/3737987115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff80414bef0 msgr2=0x7ff8041606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:29.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.115+0000 7ff808e56700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff80414bef0 0x7ff8041606b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ff7fc007d00 tx=0x7ff7fc010000).stop 2020-11-20T12:02:29.120 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.116+0000 7ff808e56700 1 -- 172.21.15.164:0/3737987115 shutdown_connections 2020-11-20T12:02:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.116+0000 7ff808e56700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff7dc080670 0x7ff7dc082b30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.116+0000 7ff808e56700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff80414bef0 0x7ff8041606b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.116+0000 7ff808e56700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7f0004e90 0x7ff804154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.116+0000 7ff808e56700 1 --2- 172.21.15.164:0/3737987115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff804156bd0 0x7ff8040bea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.116+0000 7ff808e56700 1 -- 172.21.15.164:0/3737987115 >> 172.21.15.164:0/3737987115 conn(0x7ff80407ffb0 msgr2=0x7ff80414fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.116+0000 7ff808e56700 1 -- 172.21.15.164:0/3737987115 shutdown_connections 2020-11-20T12:02:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:29.116+0000 7ff808e56700 1 -- 172.21.15.164:0/3737987115 wait complete. 2020-11-20T12:02:30.133 INFO:tasks.ceph:Scrubbing osd.0 2020-11-20T12:02:30.133 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:30.263 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.259+0000 7f2e46da0700 1 Processor -- start 2020-11-20T12:02:30.264 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.259+0000 7f2e46da0700 1 -- start start 2020-11-20T12:02:30.266 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.260+0000 7f2e46da0700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2e400c76c0 0x7f2e400c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.266 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.260+0000 7f2e46da0700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4009eee0 con 0x7f2e40060960 2020-11-20T12:02:30.267 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.260+0000 7f2e46da0700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e400610f0 con 0x7f2e40061d70 2020-11-20T12:02:30.267 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.260+0000 7f2e46da0700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e40060db0 con 0x7f2e400c76c0 2020-11-20T12:02:30.267 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e4659f700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f2e40060960 0x7f2e4014dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.164:42060/0 (socket says 172.21.15.164:42060) 2020-11-20T12:02:30.267 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e4659f700 1 -- 172.21.15.164:0/2237354052 learned_addr learned my addr 172.21.15.164:0/2237354052 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:30.268 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e45d9e700 1 --2- 172.21.15.164:0/2237354052 >> v2:172.21.15.188:3300/0 conn(0x7f2e400c76c0 0x7f2e400c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.268 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e44d9c700 1 -- 172.21.15.164:0/2237354052 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541339326 0 0) 0x7f2e4009eee0 con 0x7f2e40060960 2020-11-20T12:02:30.269 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e44d9c700 1 -- 172.21.15.164:0/2237354052 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e28003280 con 0x7f2e40060960 2020-11-20T12:02:30.269 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e45d9e700 1 -- 172.21.15.164:0/2237354052 >> v1:172.21.15.188:6789/0 conn(0x7f2e40061d70 legacy=0x7f2e40152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.269 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e45d9e700 1 -- 172.21.15.164:0/2237354052 >> v1:172.21.15.36:6789/0 conn(0x7f2e40060960 legacy=0x7f2e4014dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.269 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e45d9e700 1 -- 172.21.15.164:0/2237354052 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40061390 con 0x7f2e400c76c0 2020-11-20T12:02:30.270 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e45d9e700 1 --2- 172.21.15.164:0/2237354052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e400c76c0 0x7f2e400c7aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2e3c006fd0 tx=0x7f2e3c006e30).ready entity=mon.2 client_cookie=cf1d3f0655b7f051 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.270 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e44d9c700 1 -- 172.21.15.164:0/2237354052 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0097e0 con 0x7f2e400c76c0 2020-11-20T12:02:30.270 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e44d9c700 1 -- 172.21.15.164:0/2237354052 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c000e90 con 0x7f2e400c76c0 2020-11-20T12:02:30.270 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.261+0000 7f2e44d9c700 1 -- 172.21.15.164:0/2237354052 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c009b50 con 0x7f2e400c76c0 2020-11-20T12:02:30.270 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.262+0000 7f2e46da0700 1 -- 172.21.15.164:0/2237354052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e400c76c0 msgr2=0x7f2e400c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.262+0000 7f2e46da0700 1 --2- 172.21.15.164:0/2237354052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e400c76c0 0x7f2e400c7aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2e3c006fd0 tx=0x7f2e3c006e30).stop 2020-11-20T12:02:30.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.262+0000 7f2e46da0700 1 -- 172.21.15.164:0/2237354052 shutdown_connections 2020-11-20T12:02:30.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.262+0000 7f2e46da0700 1 --2- 172.21.15.164:0/2237354052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e400c76c0 0x7f2e400c7aa0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.262+0000 7f2e46da0700 1 -- 172.21.15.164:0/2237354052 >> 172.21.15.164:0/2237354052 conn(0x7f2e4007ffb0 msgr2=0x7f2e400803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:30.271 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.262+0000 7f2e46da0700 1 -- 172.21.15.164:0/2237354052 shutdown_connections 2020-11-20T12:02:30.272 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.262+0000 7f2e46da0700 1 -- 172.21.15.164:0/2237354052 wait complete. 2020-11-20T12:02:30.274 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.263+0000 7f2e46da0700 1 Processor -- start 2020-11-20T12:02:30.275 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.263+0000 7f2e46da0700 1 -- start start 2020-11-20T12:02:30.275 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e46da0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e40060960 0x7f2e400c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.275 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e46da0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e40061d70 0x7f2e40154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.275 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e46da0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e400c76c0 0x7f2e40154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.275 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e46da0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e401617e0 con 0x7f2e400c76c0 2020-11-20T12:02:30.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e46da0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4014e0d0 con 0x7f2e40061d70 2020-11-20T12:02:30.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e46da0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4014e370 con 0x7f2e40060960 2020-11-20T12:02:30.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e4559d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e40061d70 0x7f2e40154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e4559d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e40061d70 0x7f2e40154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46192/0 (socket says 172.21.15.164:46192) 2020-11-20T12:02:30.276 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e4559d700 1 -- 172.21.15.164:0/78567571 learned_addr learned my addr 172.21.15.164:0/78567571 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:30.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e4659f700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e400c76c0 0x7f2e40154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e45d9e700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e40060960 0x7f2e400c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e4559d700 1 -- 172.21.15.164:0/78567571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e40060960 msgr2=0x7f2e400c0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.277 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e4559d700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e40060960 0x7f2e400c0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e4559d700 1 -- 172.21.15.164:0/78567571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e400c76c0 msgr2=0x7f2e40154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e4559d700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e400c76c0 0x7f2e40154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e4559d700 1 -- 172.21.15.164:0/78567571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4014e610 con 0x7f2e40061d70 2020-11-20T12:02:30.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.264+0000 7f2e4559d700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e40061d70 0x7f2e40154120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2e3000c740 tx=0x7f2e30007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.278 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.265+0000 7f2e2dffb700 1 -- 172.21.15.164:0/78567571 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3000e4a0 con 0x7f2e40061d70 2020-11-20T12:02:30.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.265+0000 7f2e2dffb700 1 -- 172.21.15.164:0/78567571 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e30001e90 con 0x7f2e40061d70 2020-11-20T12:02:30.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.265+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4014e8b0 con 0x7f2e40061d70 2020-11-20T12:02:30.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.265+0000 7f2e2dffb700 1 -- 172.21.15.164:0/78567571 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3000e850 con 0x7f2e40061d70 2020-11-20T12:02:30.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.265+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4014dd90 con 0x7f2e40061d70 2020-11-20T12:02:30.279 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.266+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e40044fa0 con 0x7f2e40061d70 2020-11-20T12:02:30.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.266+0000 7f2e2dffb700 1 -- 172.21.15.164:0/78567571 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2e30010030 con 0x7f2e40061d70 2020-11-20T12:02:30.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.267+0000 7f2e2dffb700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2e18080670 0x7f2e18082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.267+0000 7f2e2dffb700 1 -- 172.21.15.164:0/78567571 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2e300a25d0 con 0x7f2e40061d70 2020-11-20T12:02:30.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.267+0000 7f2e45d9e700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2e18080670 0x7f2e18082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.280 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.267+0000 7f2e2dffb700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] conn(0x7f2e180893a0 0x7f2e1808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.267+0000 7f2e4659f700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] conn(0x7f2e180893a0 0x7f2e1808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.267+0000 7f2e45d9e700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2e18080670 0x7f2e18082b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2e3c006e70 tx=0x7f2e3c015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.281 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.267+0000 7f2e4659f700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] conn(0x7f2e180893a0 0x7f2e1808b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.267+0000 7f2e2dffb700 1 -- 172.21.15.164:0/78567571 --> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e1808be20 con 0x7f2e180893a0 2020-11-20T12:02:30.299 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.295+0000 7f2e2dffb700 1 -- 172.21.15.164:0/78567571 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e300a4bb0 con 0x7f2e40061d70 2020-11-20T12:02:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.338+0000 7f2e2dffb700 1 -- 172.21.15.164:0/78567571 <== osd.0 v2:172.21.15.164:6802/23229 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f2e1808be20 con 0x7f2e180893a0 2020-11-20T12:02:30.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.350+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 --> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2e40161920 con 0x7f2e180893a0 2020-11-20T12:02:30.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.370+0000 7f2e2dffb700 1 -- 172.21.15.164:0/78567571 <== osd.0 v2:172.21.15.164:6802/23229 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2e40161920 con 0x7f2e180893a0 2020-11-20T12:02:30.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] conn(0x7f2e180893a0 msgr2=0x7f2e1808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e46da0700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:6802/23229,v1:172.21.15.164:6803/23229] conn(0x7f2e180893a0 0x7f2e1808b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2e18080670 msgr2=0x7f2e18082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e46da0700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2e18080670 0x7f2e18082b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2e3c006e70 tx=0x7f2e3c015000).stop 2020-11-20T12:02:30.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e40061d70 msgr2=0x7f2e40154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e46da0700 1 --2- 172.21.15.164:0/78567571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e40061d70 0x7f2e40154120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2e3000c740 tx=0x7f2e30007c20).stop 2020-11-20T12:02:30.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e4659f700 1 -- 172.21.15.164:0/78567571 reap_dead start 2020-11-20T12:02:30.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 shutdown_connections 2020-11-20T12:02:30.377 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 >> 172.21.15.164:0/78567571 conn(0x7f2e4007ffb0 msgr2=0x7f2e4009e700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:30.378 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 shutdown_connections 2020-11-20T12:02:30.378 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.371+0000 7f2e46da0700 1 -- 172.21.15.164:0/78567571 wait complete. 2020-11-20T12:02:30.378 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:30.378 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:30.379 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:30.387 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2020-11-20T12:02:30.498 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.494+0000 7fef7e763700 1 Processor -- start 2020-11-20T12:02:30.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.494+0000 7fef7e763700 1 -- start start 2020-11-20T12:02:30.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.495+0000 7fef7e763700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fef780c4470 0x7fef780c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.495+0000 7fef7e763700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fef780bf680 0x7fef780bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.495+0000 7fef7e763700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef781555a0 con 0x7fef780bccf0 2020-11-20T12:02:30.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.495+0000 7fef7e763700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef780c0000 con 0x7fef780bf680 2020-11-20T12:02:30.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.495+0000 7fef7e763700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef781517d0 con 0x7fef780c4470 2020-11-20T12:02:30.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.495+0000 7fef777fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fef780bccf0 0x7fef780c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55940/0 (socket says 172.21.15.164:55940) 2020-11-20T12:02:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.495+0000 7fef777fe700 1 -- 172.21.15.164:0/3930411125 learned_addr learned my addr 172.21.15.164:0/3930411125 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef77fff700 1 --2- 172.21.15.164:0/3930411125 >> v2:172.21.15.188:3300/0 conn(0x7fef780c4470 0x7fef780c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef7cd00700 1 --2- 172.21.15.164:0/3930411125 >> v2:172.21.15.36:3300/0 conn(0x7fef780bf680 0x7fef780bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef76ffd700 1 -- 172.21.15.164:0/3930411125 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927591836 0 0) 0x7fef781555a0 con 0x7fef780bccf0 2020-11-20T12:02:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef76ffd700 1 -- 172.21.15.164:0/3930411125 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef64003280 con 0x7fef780bccf0 2020-11-20T12:02:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef77fff700 1 -- 172.21.15.164:0/3930411125 >> v2:172.21.15.36:3300/0 conn(0x7fef780bf680 msgr2=0x7fef780bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef77fff700 1 --2- 172.21.15.164:0/3930411125 >> v2:172.21.15.36:3300/0 conn(0x7fef780bf680 0x7fef780bfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef77fff700 1 -- 172.21.15.164:0/3930411125 >> v1:172.21.15.164:6789/0 conn(0x7fef780bccf0 legacy=0x7fef780c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef77fff700 1 -- 172.21.15.164:0/3930411125 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78151a70 con 0x7fef780c4470 2020-11-20T12:02:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef77fff700 1 --2- 172.21.15.164:0/3930411125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef780c4470 0x7fef780c4850 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fef78081020 tx=0x7fef68006e30).ready entity=mon.2 client_cookie=9347d45bd470d936 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef76ffd700 1 -- 172.21.15.164:0/3930411125 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68009650 con 0x7fef780c4470 2020-11-20T12:02:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef76ffd700 1 -- 172.21.15.164:0/3930411125 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef68000e90 con 0x7fef780c4470 2020-11-20T12:02:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.496+0000 7fef76ffd700 1 -- 172.21.15.164:0/3930411125 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680099c0 con 0x7fef780c4470 2020-11-20T12:02:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.497+0000 7fef7e763700 1 -- 172.21.15.164:0/3930411125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef780c4470 msgr2=0x7fef780c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.497+0000 7fef7e763700 1 --2- 172.21.15.164:0/3930411125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef780c4470 0x7fef780c4850 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fef78081020 tx=0x7fef68006e30).stop 2020-11-20T12:02:30.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.497+0000 7fef7e763700 1 -- 172.21.15.164:0/3930411125 shutdown_connections 2020-11-20T12:02:30.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.497+0000 7fef7e763700 1 --2- 172.21.15.164:0/3930411125 >> v2:172.21.15.36:3300/0 conn(0x7fef780bf680 0x7fef780bfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.497+0000 7fef7e763700 1 --2- 172.21.15.164:0/3930411125 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef780c4470 0x7fef780c4850 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.497+0000 7fef7e763700 1 -- 172.21.15.164:0/3930411125 >> 172.21.15.164:0/3930411125 conn(0x7fef780683b0 msgr2=0x7fef78061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:30.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.497+0000 7fef7e763700 1 -- 172.21.15.164:0/3930411125 shutdown_connections 2020-11-20T12:02:30.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.497+0000 7fef7e763700 1 -- 172.21.15.164:0/3930411125 wait complete. 2020-11-20T12:02:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.498+0000 7fef7e763700 1 Processor -- start 2020-11-20T12:02:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.498+0000 7fef7e763700 1 -- start start 2020-11-20T12:02:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7e763700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef780bccf0 0x7fef78155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7e763700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef780bf680 0x7fef78155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7e763700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef780c4470 0x7fef78163b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7e763700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78155560 con 0x7fef780bf680 2020-11-20T12:02:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7e763700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78112900 con 0x7fef780c4470 2020-11-20T12:02:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7e763700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78112ba0 con 0x7fef780bccf0 2020-11-20T12:02:30.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7cd00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef780c4470 0x7fef78163b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7cd00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef780c4470 0x7fef78163b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46208/0 (socket says 172.21.15.164:46208) 2020-11-20T12:02:30.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7cd00700 1 -- 172.21.15.164:0/805054814 learned_addr learned my addr 172.21.15.164:0/805054814 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:30.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef777fe700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef780bf680 0x7fef78155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef77fff700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef780bccf0 0x7fef78155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7cd00700 1 -- 172.21.15.164:0/805054814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef780bccf0 msgr2=0x7fef78155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7cd00700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef780bccf0 0x7fef78155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7cd00700 1 -- 172.21.15.164:0/805054814 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef780bf680 msgr2=0x7fef78155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7cd00700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef780bf680 0x7fef78155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7cd00700 1 -- 172.21.15.164:0/805054814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78112e40 con 0x7fef780c4470 2020-11-20T12:02:30.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef777fe700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef780bf680 0x7fef78155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:30.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7cd00700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef780c4470 0x7fef78163b50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fef7000ef50 tx=0x7fef70009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef57fff700 1 -- 172.21.15.164:0/805054814 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000ccc0 con 0x7fef780c4470 2020-11-20T12:02:30.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef57fff700 1 -- 172.21.15.164:0/805054814 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7000ce20 con 0x7fef780c4470 2020-11-20T12:02:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef57fff700 1 -- 172.21.15.164:0/805054814 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70012620 con 0x7fef780c4470 2020-11-20T12:02:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.499+0000 7fef7e763700 1 -- 172.21.15.164:0/805054814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef78152540 con 0x7fef780c4470 2020-11-20T12:02:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.500+0000 7fef7e763700 1 -- 172.21.15.164:0/805054814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef781125f0 con 0x7fef780c4470 2020-11-20T12:02:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.500+0000 7fef7e763700 1 -- 172.21.15.164:0/805054814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef781529a0 con 0x7fef780c4470 2020-11-20T12:02:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.501+0000 7fef57fff700 1 -- 172.21.15.164:0/805054814 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fef70022070 con 0x7fef780c4470 2020-11-20T12:02:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.501+0000 7fef57fff700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef50080670 0x7fef50082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.501+0000 7fef57fff700 1 -- 172.21.15.164:0/805054814 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fef700a3320 con 0x7fef780c4470 2020-11-20T12:02:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.502+0000 7fef77fff700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef50080670 0x7fef50082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.502+0000 7fef77fff700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef50080670 0x7fef50082b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fef68006e70 tx=0x7fef68015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.505+0000 7fef57fff700 1 -- 172.21.15.164:0/805054814 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fef70077cb0 con 0x7fef780c4470 2020-11-20T12:02:30.648 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.643+0000 7fef7e763700 1 -- 172.21.15.164:0/805054814 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fef78069b70 con 0x7fef50080670 2020-11-20T12:02:30.648 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.644+0000 7fef57fff700 1 -- 172.21.15.164:0/805054814 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fef78069b70 con 0x7fef50080670 2020-11-20T12:02:30.649 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 -- 172.21.15.164:0/805054814 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef50080670 msgr2=0x7fef50082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef50080670 0x7fef50082b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fef68006e70 tx=0x7fef68015000).stop 2020-11-20T12:02:30.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 -- 172.21.15.164:0/805054814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef780c4470 msgr2=0x7fef78163b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef780c4470 0x7fef78163b50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fef7000ef50 tx=0x7fef70009220).stop 2020-11-20T12:02:30.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 -- 172.21.15.164:0/805054814 shutdown_connections 2020-11-20T12:02:30.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fef50080670 0x7fef50082b30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef780c4470 0x7fef78163b50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef780bccf0 0x7fef78155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 --2- 172.21.15.164:0/805054814 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef780bf680 0x7fef78155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 -- 172.21.15.164:0/805054814 >> 172.21.15.164:0/805054814 conn(0x7fef780683b0 msgr2=0x7fef780c27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:30.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 -- 172.21.15.164:0/805054814 shutdown_connections 2020-11-20T12:02:30.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.645+0000 7fef7e763700 1 -- 172.21.15.164:0/805054814 wait complete. 2020-11-20T12:02:30.652 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 0 to deep-scrub 2020-11-20T12:02:30.661 INFO:tasks.ceph:Scrubbing osd.3 2020-11-20T12:02:30.661 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:30.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.775+0000 7f4d5c814700 1 Processor -- start 2020-11-20T12:02:30.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.775+0000 7f4d5c814700 1 -- start start 2020-11-20T12:02:30.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.776+0000 7f4d5c814700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4d58155330 0x7f4d580c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.776+0000 7f4d5c814700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5809d300 con 0x7f4d580c2180 2020-11-20T12:02:30.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.776+0000 7f4d5c814700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d58151f70 con 0x7f4d580c4360 2020-11-20T12:02:30.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.776+0000 7f4d5c814700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5809e8c0 con 0x7f4d58155330 2020-11-20T12:02:30.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.776+0000 7f4d4ffff700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4d58155330 0x7f4d580c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.776+0000 7f4d56d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f4d580c2180 0x7f4d5814e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.164:42086/0 (socket says 172.21.15.164:42086) 2020-11-20T12:02:30.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.776+0000 7f4d56d9d700 1 -- 172.21.15.164:0/1362434123 learned_addr learned my addr 172.21.15.164:0/1362434123 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:30.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d55d9b700 1 -- 172.21.15.164:0/1362434123 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445545567 0 0) 0x7f4d5809d300 con 0x7f4d580c2180 2020-11-20T12:02:30.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d4ffff700 1 -- 172.21.15.164:0/1362434123 >> v1:172.21.15.188:6789/0 conn(0x7f4d580c4360 legacy=0x7f4d5809e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d4ffff700 1 -- 172.21.15.164:0/1362434123 >> v1:172.21.15.36:6789/0 conn(0x7f4d580c2180 legacy=0x7f4d5814e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d4ffff700 1 -- 172.21.15.164:0/1362434123 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5809d530 con 0x7f4d58155330 2020-11-20T12:02:30.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d4ffff700 1 --2- 172.21.15.164:0/1362434123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d58155330 0x7f4d580c4740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4d40006fd0 tx=0x7f4d40006e30).ready entity=mon.2 client_cookie=8e4862dbab854370 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d55d9b700 1 -- 172.21.15.164:0/1362434123 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40009870 con 0x7f4d58155330 2020-11-20T12:02:30.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d55d9b700 1 -- 172.21.15.164:0/1362434123 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40000e90 con 0x7f4d58155330 2020-11-20T12:02:30.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d55d9b700 1 -- 172.21.15.164:0/1362434123 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40009be0 con 0x7f4d58155330 2020-11-20T12:02:30.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d5c814700 1 -- 172.21.15.164:0/1362434123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d58155330 msgr2=0x7f4d580c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d5c814700 1 --2- 172.21.15.164:0/1362434123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d58155330 0x7f4d580c4740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4d40006fd0 tx=0x7f4d40006e30).stop 2020-11-20T12:02:30.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d5c814700 1 -- 172.21.15.164:0/1362434123 shutdown_connections 2020-11-20T12:02:30.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d5c814700 1 --2- 172.21.15.164:0/1362434123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d58155330 0x7f4d580c4740 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d5c814700 1 -- 172.21.15.164:0/1362434123 >> 172.21.15.164:0/1362434123 conn(0x7f4d58068370 msgr2=0x7f4d5807ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:30.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d5c814700 1 -- 172.21.15.164:0/1362434123 shutdown_connections 2020-11-20T12:02:30.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.777+0000 7f4d5c814700 1 -- 172.21.15.164:0/1362434123 wait complete. 2020-11-20T12:02:30.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.778+0000 7f4d5c814700 1 Processor -- start 2020-11-20T12:02:30.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.779+0000 7f4d5c814700 1 -- start start 2020-11-20T12:02:30.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.779+0000 7f4d5c814700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d580c2180 0x7f4d580c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.779+0000 7f4d5c814700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d580c4360 0x7f4d580c1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.779+0000 7f4d5c814700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4d58155330 0x7f4d580c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.779+0000 7f4d5c814700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d580be5d0 con 0x7f4d58155330 2020-11-20T12:02:30.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.779+0000 7f4d5c814700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d580bdb80 con 0x7f4d580c2180 2020-11-20T12:02:30.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.779+0000 7f4d5c814700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d580be090 con 0x7f4d580c4360 2020-11-20T12:02:30.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.779+0000 7f4d5659c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d580c2180 0x7f4d580c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.779+0000 7f4d5659c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d580c2180 0x7f4d580c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46218/0 (socket says 172.21.15.164:46218) 2020-11-20T12:02:30.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.779+0000 7f4d5659c700 1 -- 172.21.15.164:0/4177479761 learned_addr learned my addr 172.21.15.164:0/4177479761 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:30.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d4ffff700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d580c4360 0x7f4d580c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d56d9d700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4d58155330 0x7f4d580c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d5659c700 1 -- 172.21.15.164:0/4177479761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d580c4360 msgr2=0x7f4d580c1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d5659c700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d580c4360 0x7f4d580c1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d5659c700 1 -- 172.21.15.164:0/4177479761 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4d58155330 msgr2=0x7f4d580c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d5659c700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4d58155330 0x7f4d580c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d5659c700 1 -- 172.21.15.164:0/4177479761 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d580be330 con 0x7f4d580c2180 2020-11-20T12:02:30.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d4ffff700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d580c4360 0x7f4d580c1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:30.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d5659c700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d580c2180 0x7f4d580c6320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f4d48001eb0 tx=0x7f4d48007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d4e7fc700 1 -- 172.21.15.164:0/4177479761 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48010510 con 0x7f4d580c2180 2020-11-20T12:02:30.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d4e7fc700 1 -- 172.21.15.164:0/4177479761 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d48010670 con 0x7f4d580c2180 2020-11-20T12:02:30.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d58164030 con 0x7f4d580c2180 2020-11-20T12:02:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d4e7fc700 1 -- 172.21.15.164:0/4177479761 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48010a10 con 0x7f4d580c2180 2020-11-20T12:02:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.780+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d58160a40 con 0x7f4d580c2180 2020-11-20T12:02:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.781+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d580c86e0 con 0x7f4d580c2180 2020-11-20T12:02:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.781+0000 7f4d4e7fc700 1 -- 172.21.15.164:0/4177479761 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4d48010070 con 0x7f4d580c2180 2020-11-20T12:02:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.782+0000 7f4d4e7fc700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4d340806a0 0x7f4d34082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.782+0000 7f4d4e7fc700 1 -- 172.21.15.164:0/4177479761 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f4d480a2fa0 con 0x7f4d580c2180 2020-11-20T12:02:30.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.782+0000 7f4d4ffff700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4d340806a0 0x7f4d34082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.782+0000 7f4d4e7fc700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] conn(0x7f4d340893d0 0x7f4d3408b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.782+0000 7f4d4e7fc700 1 -- 172.21.15.164:0/4177479761 --> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d3408be50 con 0x7f4d340893d0 2020-11-20T12:02:30.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.782+0000 7f4d4e7fc700 1 -- 172.21.15.164:0/4177479761 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d480a3310 con 0x7f4d580c2180 2020-11-20T12:02:30.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.782+0000 7f4d4ffff700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4d340806a0 0x7f4d34082b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f4d58155770 tx=0x7f4d40015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.782+0000 7f4d56d9d700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] conn(0x7f4d340893d0 0x7f4d3408b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.783+0000 7f4d56d9d700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] conn(0x7f4d340893d0 0x7f4d3408b7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.783+0000 7f4d4e7fc700 1 -- 172.21.15.164:0/4177479761 <== osd.3 v2:172.21.15.164:6810/23230 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f4d3408be50 con 0x7f4d340893d0 2020-11-20T12:02:30.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.796+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 --> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d580c51a0 con 0x7f4d340893d0 2020-11-20T12:02:30.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.796+0000 7f4d4e7fc700 1 -- 172.21.15.164:0/4177479761 <== osd.3 v2:172.21.15.164:6810/23230 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4d580c51a0 con 0x7f4d340893d0 2020-11-20T12:02:30.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] conn(0x7f4d340893d0 msgr2=0x7f4d3408b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d5c814700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:6810/23230,v1:172.21.15.164:6811/23230] conn(0x7f4d340893d0 0x7f4d3408b7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4d340806a0 msgr2=0x7f4d34082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d5c814700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f4d340806a0 0x7f4d34082b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f4d58155770 tx=0x7f4d40015000).stop 2020-11-20T12:02:30.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d580c2180 msgr2=0x7f4d580c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.802 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d5c814700 1 --2- 172.21.15.164:0/4177479761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d580c2180 0x7f4d580c6320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f4d48001eb0 tx=0x7f4d48007c50).stop 2020-11-20T12:02:30.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d56d9d700 1 -- 172.21.15.164:0/4177479761 reap_dead start 2020-11-20T12:02:30.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 shutdown_connections 2020-11-20T12:02:30.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 >> 172.21.15.164:0/4177479761 conn(0x7f4d58068370 msgr2=0x7f4d580c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:30.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 shutdown_connections 2020-11-20T12:02:30.803 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.797+0000 7f4d5c814700 1 -- 172.21.15.164:0/4177479761 wait complete. 2020-11-20T12:02:30.804 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:30.804 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:30.804 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:30.812 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2020-11-20T12:02:30.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.926+0000 7ff246822700 1 Processor -- start 2020-11-20T12:02:30.931 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.926+0000 7ff246822700 1 -- start start 2020-11-20T12:02:30.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.927+0000 7ff246822700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff2400bfd90 0x7ff2400c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.927+0000 7ff246822700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2401555a0 con 0x7ff2400bccf0 2020-11-20T12:02:30.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.927+0000 7ff246822700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2401517d0 con 0x7ff2400c4470 2020-11-20T12:02:30.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.927+0000 7ff246822700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff240151a70 con 0x7ff2400bfd90 2020-11-20T12:02:30.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.927+0000 7ff244dbf700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff2400bfd90 0x7ff2400c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.927+0000 7ff244dbf700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff2400bfd90 0x7ff2400c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46232/0 (socket says 172.21.15.164:46232) 2020-11-20T12:02:30.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.927+0000 7ff244dbf700 1 -- 172.21.15.164:0/2561935114 learned_addr learned my addr 172.21.15.164:0/2561935114 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:30.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff244dbf700 1 -- 172.21.15.164:0/2561935114 >> v1:172.21.15.188:6789/0 conn(0x7ff2400c4470 legacy=0x7ff2400c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff244dbf700 1 -- 172.21.15.164:0/2561935114 >> v1:172.21.15.36:6789/0 conn(0x7ff2400bccf0 legacy=0x7ff2400bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:30.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff244dbf700 1 -- 172.21.15.164:0/2561935114 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240151d10 con 0x7ff2400bfd90 2020-11-20T12:02:30.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff244dbf700 1 --2- 172.21.15.164:0/2561935114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 0x7ff2400c4850 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7ff238009d90 tx=0x7ff2380092d0).ready entity=mon.1 client_cookie=d192c70b304b91a3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff23effd700 1 -- 172.21.15.164:0/2561935114 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23800bc40 con 0x7ff2400bfd90 2020-11-20T12:02:30.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff23effd700 1 -- 172.21.15.164:0/2561935114 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23800bda0 con 0x7ff2400bfd90 2020-11-20T12:02:30.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff23effd700 1 -- 172.21.15.164:0/2561935114 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238011610 con 0x7ff2400bfd90 2020-11-20T12:02:30.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff246822700 1 -- 172.21.15.164:0/2561935114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 msgr2=0x7ff2400c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff246822700 1 --2- 172.21.15.164:0/2561935114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 0x7ff2400c4850 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7ff238009d90 tx=0x7ff2380092d0).stop 2020-11-20T12:02:30.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff246822700 1 -- 172.21.15.164:0/2561935114 shutdown_connections 2020-11-20T12:02:30.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff246822700 1 --2- 172.21.15.164:0/2561935114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 0x7ff2400c4850 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff246822700 1 -- 172.21.15.164:0/2561935114 >> 172.21.15.164:0/2561935114 conn(0x7ff2400683b0 msgr2=0x7ff240061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:30.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff246822700 1 -- 172.21.15.164:0/2561935114 shutdown_connections 2020-11-20T12:02:30.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.928+0000 7ff246822700 1 -- 172.21.15.164:0/2561935114 wait complete. 2020-11-20T12:02:30.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.929+0000 7ff246822700 1 Processor -- start 2020-11-20T12:02:30.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.930+0000 7ff246822700 1 -- start start 2020-11-20T12:02:30.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.930+0000 7ff246822700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2400bccf0 0x7ff240164560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.930+0000 7ff246822700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 0x7ff240161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.940 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.930+0000 7ff246822700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2400c4470 0x7ff240160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.930+0000 7ff246822700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2401605f0 con 0x7ff2400bccf0 2020-11-20T12:02:30.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.930+0000 7ff246822700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff240164a50 con 0x7ff2400bfd90 2020-11-20T12:02:30.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.930+0000 7ff246822700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff240112700 con 0x7ff2400c4470 2020-11-20T12:02:30.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.930+0000 7ff23f7fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 0x7ff240161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.941 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff23f7fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 0x7ff240161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46236/0 (socket says 172.21.15.164:46236) 2020-11-20T12:02:30.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff23f7fe700 1 -- 172.21.15.164:0/1981395869 learned_addr learned my addr 172.21.15.164:0/1981395869 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:30.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff23ffff700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2400bccf0 0x7ff240164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff244dbf700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2400c4470 0x7ff240160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff23f7fe700 1 -- 172.21.15.164:0/1981395869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2400c4470 msgr2=0x7ff240160f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.942 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff23f7fe700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2400c4470 0x7ff240160f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff23f7fe700 1 -- 172.21.15.164:0/1981395869 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2400bccf0 msgr2=0x7ff240164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:30.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff23f7fe700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2400bccf0 0x7ff240164560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:30.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff23f7fe700 1 -- 172.21.15.164:0/1981395869 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240161f40 con 0x7ff2400bfd90 2020-11-20T12:02:30.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff23ffff700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2400bccf0 0x7ff240164560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:30.943 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff23f7fe700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 0x7ff240161a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7ff23400c730 tx=0x7ff234007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff227fff700 1 -- 172.21.15.164:0/1981395869 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234010510 con 0x7ff2400bfd90 2020-11-20T12:02:30.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff227fff700 1 -- 172.21.15.164:0/1981395869 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff234010690 con 0x7ff2400bfd90 2020-11-20T12:02:30.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff246822700 1 -- 172.21.15.164:0/1981395869 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff240112960 con 0x7ff2400bfd90 2020-11-20T12:02:30.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff227fff700 1 -- 172.21.15.164:0/1981395869 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234010a50 con 0x7ff2400bfd90 2020-11-20T12:02:30.944 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.931+0000 7ff246822700 1 -- 172.21.15.164:0/1981395869 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff240112ea0 con 0x7ff2400bfd90 2020-11-20T12:02:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.932+0000 7ff246822700 1 -- 172.21.15.164:0/1981395869 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff240069b70 con 0x7ff2400bfd90 2020-11-20T12:02:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.933+0000 7ff227fff700 1 -- 172.21.15.164:0/1981395869 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff234010070 con 0x7ff2400bfd90 2020-11-20T12:02:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.933+0000 7ff227fff700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff21c080670 0x7ff21c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.933+0000 7ff227fff700 1 -- 172.21.15.164:0/1981395869 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff2340a25d0 con 0x7ff2400bfd90 2020-11-20T12:02:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.933+0000 7ff23ffff700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff21c080670 0x7ff21c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.934+0000 7ff23ffff700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff21c080670 0x7ff21c082b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff230001510 tx=0x7ff230009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:30.937+0000 7ff227fff700 1 -- 172.21.15.164:0/1981395869 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff234074fd0 con 0x7ff2400bfd90 2020-11-20T12:02:31.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.078+0000 7ff246822700 1 -- 172.21.15.164:0/1981395869 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff240151490 con 0x7ff21c080670 2020-11-20T12:02:31.083 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.079+0000 7ff227fff700 1 -- 172.21.15.164:0/1981395869 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff240151490 con 0x7ff21c080670 2020-11-20T12:02:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 -- 172.21.15.164:0/1981395869 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff21c080670 msgr2=0x7ff21c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff21c080670 0x7ff21c082b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff230001510 tx=0x7ff230009040).stop 2020-11-20T12:02:31.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 -- 172.21.15.164:0/1981395869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 msgr2=0x7ff240161a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 0x7ff240161a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7ff23400c730 tx=0x7ff234007c70).stop 2020-11-20T12:02:31.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 -- 172.21.15.164:0/1981395869 shutdown_connections 2020-11-20T12:02:31.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7ff21c080670 0x7ff21c082b30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.085 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff2400c4470 0x7ff240160f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2400bccf0 0x7ff240164560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 --2- 172.21.15.164:0/1981395869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2400bfd90 0x7ff240161a50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 -- 172.21.15.164:0/1981395869 >> 172.21.15.164:0/1981395869 conn(0x7ff2400683b0 msgr2=0x7ff2400c2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 -- 172.21.15.164:0/1981395869 shutdown_connections 2020-11-20T12:02:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.080+0000 7ff246822700 1 -- 172.21.15.164:0/1981395869 wait complete. 2020-11-20T12:02:31.087 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 3 to deep-scrub 2020-11-20T12:02:31.096 INFO:tasks.ceph:Scrubbing osd.6 2020-11-20T12:02:31.096 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:31.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.210+0000 7f45f3be4700 1 Processor -- start 2020-11-20T12:02:31.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.210+0000 7f45f3be4700 1 -- start start 2020-11-20T12:02:31.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f3be4700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f45ec0c4360 0x7f45ec0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f3be4700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f45ec155330 0x7f45ec0c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f3be4700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ec09d300 con 0x7f45ec09e1b0 2020-11-20T12:02:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f3be4700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ec09f720 con 0x7f45ec0c4360 2020-11-20T12:02:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f3be4700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ec151f70 con 0x7f45ec155330 2020-11-20T12:02:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f1980700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f45ec0c4360 0x7f45ec0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f1980700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f45ec0c4360 0x7f45ec0c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46244/0 (socket says 172.21.15.164:46244) 2020-11-20T12:02:31.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f1980700 1 -- 172.21.15.164:0/2320688195 learned_addr learned my addr 172.21.15.164:0/2320688195 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:31.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f117f700 1 --2- 172.21.15.164:0/2320688195 >> v2:172.21.15.188:3300/0 conn(0x7f45ec155330 0x7f45ec0c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f1980700 1 -- 172.21.15.164:0/2320688195 >> v2:172.21.15.188:3300/0 conn(0x7f45ec155330 msgr2=0x7f45ec0c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:31.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f1980700 1 --2- 172.21.15.164:0/2320688195 >> v2:172.21.15.188:3300/0 conn(0x7f45ec155330 0x7f45ec0c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f1980700 1 -- 172.21.15.164:0/2320688195 >> v1:172.21.15.188:6789/0 conn(0x7f45ec09e1b0 legacy=0x7f45ec14e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:31.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f1980700 1 -- 172.21.15.164:0/2320688195 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec09d530 con 0x7f45ec0c4360 2020-11-20T12:02:31.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f117f700 1 --2- 172.21.15.164:0/2320688195 >> v2:172.21.15.188:3300/0 conn(0x7f45ec155330 0x7f45ec0c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:31.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f1980700 1 --2- 172.21.15.164:0/2320688195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45ec0c4360 0x7f45ec0c4740 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f45ec0687a0 tx=0x7f45e8006ef0).ready entity=mon.1 client_cookie=64e2b9c2ae99e973 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f097e700 1 -- 172.21.15.164:0/2320688195 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e800b8b0 con 0x7f45ec0c4360 2020-11-20T12:02:31.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f097e700 1 -- 172.21.15.164:0/2320688195 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8000e90 con 0x7f45ec0c4360 2020-11-20T12:02:31.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.211+0000 7f45f097e700 1 -- 172.21.15.164:0/2320688195 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e800bc20 con 0x7f45ec0c4360 2020-11-20T12:02:31.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.212+0000 7f45f3be4700 1 -- 172.21.15.164:0/2320688195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45ec0c4360 msgr2=0x7f45ec0c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.212+0000 7f45f3be4700 1 --2- 172.21.15.164:0/2320688195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45ec0c4360 0x7f45ec0c4740 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f45ec0687a0 tx=0x7f45e8006ef0).stop 2020-11-20T12:02:31.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.212+0000 7f45f3be4700 1 -- 172.21.15.164:0/2320688195 shutdown_connections 2020-11-20T12:02:31.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.212+0000 7f45f3be4700 1 --2- 172.21.15.164:0/2320688195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45ec0c4360 0x7f45ec0c4740 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.212+0000 7f45f3be4700 1 --2- 172.21.15.164:0/2320688195 >> v2:172.21.15.188:3300/0 conn(0x7f45ec155330 0x7f45ec0c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.212+0000 7f45f3be4700 1 -- 172.21.15.164:0/2320688195 >> 172.21.15.164:0/2320688195 conn(0x7f45ec068370 msgr2=0x7f45ec07ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:31.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.212+0000 7f45f3be4700 1 -- 172.21.15.164:0/2320688195 shutdown_connections 2020-11-20T12:02:31.221 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.212+0000 7f45f3be4700 1 -- 172.21.15.164:0/2320688195 wait complete. 2020-11-20T12:02:31.224 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.213+0000 7f45f3be4700 1 Processor -- start 2020-11-20T12:02:31.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.213+0000 7f45f3be4700 1 -- start start 2020-11-20T12:02:31.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f3be4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45ec09e1b0 0x7f45ec0bc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f3be4700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45ec0c4360 0x7f45ec14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f3be4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45ec155330 0x7f45ec160f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f3be4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec160840 con 0x7f45ec155330 2020-11-20T12:02:31.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f3be4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0bcd40 con 0x7f45ec09e1b0 2020-11-20T12:02:31.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f3be4700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0bcfe0 con 0x7f45ec0c4360 2020-11-20T12:02:31.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f1980700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45ec09e1b0 0x7f45ec0bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f1980700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45ec09e1b0 0x7f45ec0bc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46248/0 (socket says 172.21.15.164:46248) 2020-11-20T12:02:31.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f1980700 1 -- 172.21.15.164:0/3739052246 learned_addr learned my addr 172.21.15.164:0/3739052246 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:31.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f117f700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45ec0c4360 0x7f45ec14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f2181700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45ec155330 0x7f45ec160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f1980700 1 -- 172.21.15.164:0/3739052246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45ec0c4360 msgr2=0x7f45ec14d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f1980700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45ec0c4360 0x7f45ec14d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f1980700 1 -- 172.21.15.164:0/3739052246 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45ec155330 msgr2=0x7f45ec160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f1980700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45ec155330 0x7f45ec160f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f1980700 1 -- 172.21.15.164:0/3739052246 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec0bd280 con 0x7f45ec09e1b0 2020-11-20T12:02:31.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f117f700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45ec0c4360 0x7f45ec14d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:31.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f2181700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45ec155330 0x7f45ec160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:31.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f1980700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45ec09e1b0 0x7f45ec0bc760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f45ec0688c0 tx=0x7f45e8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45d9ffb700 1 -- 172.21.15.164:0/3739052246 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8011e70 con 0x7f45ec09e1b0 2020-11-20T12:02:31.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45d9ffb700 1 -- 172.21.15.164:0/3739052246 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e801d480 con 0x7f45ec09e1b0 2020-11-20T12:02:31.229 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ec160aa0 con 0x7f45ec09e1b0 2020-11-20T12:02:31.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.214+0000 7f45d9ffb700 1 -- 172.21.15.164:0/3739052246 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e801d860 con 0x7f45ec09e1b0 2020-11-20T12:02:31.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.215+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec0bc2e0 con 0x7f45ec09e1b0 2020-11-20T12:02:31.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.215+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45ec069b70 con 0x7f45ec09e1b0 2020-11-20T12:02:31.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.216+0000 7f45d9ffb700 1 -- 172.21.15.164:0/3739052246 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f45e8017070 con 0x7f45ec09e1b0 2020-11-20T12:02:31.230 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.217+0000 7f45d9ffb700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f45c4080670 0x7f45c4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.217+0000 7f45d9ffb700 1 -- 172.21.15.164:0/3739052246 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f45e80a5550 con 0x7f45ec09e1b0 2020-11-20T12:02:31.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.217+0000 7f45f117f700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f45c4080670 0x7f45c4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.217+0000 7f45d9ffb700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] conn(0x7f45c40893a0 0x7f45c408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.217+0000 7f45d9ffb700 1 -- 172.21.15.164:0/3739052246 --> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45c408be20 con 0x7f45c40893a0 2020-11-20T12:02:31.231 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.217+0000 7f45d9ffb700 1 -- 172.21.15.164:0/3739052246 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45e80a58c0 con 0x7f45ec09e1b0 2020-11-20T12:02:31.232 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.217+0000 7f45f2181700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] conn(0x7f45c40893a0 0x7f45c408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.232 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.217+0000 7f45f117f700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f45c4080670 0x7f45c4082b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f45ec0c6fa0 tx=0x7f45dc008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.232 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.218+0000 7f45f2181700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] conn(0x7f45c40893a0 0x7f45c408b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.232 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.218+0000 7f45d9ffb700 1 -- 172.21.15.164:0/3739052246 <== osd.6 v2:172.21.15.164:6812/23231 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f45c408be20 con 0x7f45c40893a0 2020-11-20T12:02:31.235 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.231+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 --> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f45ec0be820 con 0x7f45c40893a0 2020-11-20T12:02:31.236 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45d9ffb700 1 -- 172.21.15.164:0/3739052246 <== osd.6 v2:172.21.15.164:6812/23231 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f45ec0be820 con 0x7f45c40893a0 2020-11-20T12:02:31.237 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] conn(0x7f45c40893a0 msgr2=0x7f45c408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.237 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f3be4700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:6812/23231,v1:172.21.15.164:6814/23231] conn(0x7f45c40893a0 0x7f45c408b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.237 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f45c4080670 msgr2=0x7f45c4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.237 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f3be4700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f45c4080670 0x7f45c4082b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f45ec0c6fa0 tx=0x7f45dc008040).stop 2020-11-20T12:02:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45ec09e1b0 msgr2=0x7f45ec0bc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f3be4700 1 --2- 172.21.15.164:0/3739052246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45ec09e1b0 0x7f45ec0bc760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f45ec0688c0 tx=0x7f45e8016000).stop 2020-11-20T12:02:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f2181700 1 -- 172.21.15.164:0/3739052246 reap_dead start 2020-11-20T12:02:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 shutdown_connections 2020-11-20T12:02:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 >> 172.21.15.164:0/3739052246 conn(0x7f45ec068370 msgr2=0x7f45ec0c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 shutdown_connections 2020-11-20T12:02:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.232+0000 7f45f3be4700 1 -- 172.21.15.164:0/3739052246 wait complete. 2020-11-20T12:02:31.239 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:31.239 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:31.239 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:31.248 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2020-11-20T12:02:31.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.357+0000 7fb019006700 1 Processor -- start 2020-11-20T12:02:31.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.357+0000 7fb019006700 1 -- start start 2020-11-20T12:02:31.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.358+0000 7fb019006700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb0140c4200 0x7fb0140bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.358+0000 7fb019006700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb014151780 con 0x7fb0140c45e0 2020-11-20T12:02:31.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.358+0000 7fb019006700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb014151a20 con 0x7fb0140c0ba0 2020-11-20T12:02:31.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.358+0000 7fb019006700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0140c4a60 con 0x7fb0140c4200 2020-11-20T12:02:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.358+0000 7fb012d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb0140c4200 0x7fb0140bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.358+0000 7fb012d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb0140c4200 0x7fb0140bccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46258/0 (socket says 172.21.15.164:46258) 2020-11-20T12:02:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.358+0000 7fb012d9d700 1 -- 172.21.15.164:0/1728973270 learned_addr learned my addr 172.21.15.164:0/1728973270 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb012d9d700 1 -- 172.21.15.164:0/1728973270 >> v1:172.21.15.188:6789/0 conn(0x7fb0140c0ba0 legacy=0x7fb0140bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb012d9d700 1 -- 172.21.15.164:0/1728973270 >> v1:172.21.15.36:6789/0 conn(0x7fb0140c45e0 legacy=0x7fb014150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb012d9d700 1 -- 172.21.15.164:0/1728973270 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014151cc0 con 0x7fb0140c4200 2020-11-20T12:02:31.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb012d9d700 1 --2- 172.21.15.164:0/1728973270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c4200 0x7fb0140bccf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fb004009a10 tx=0x7fb004006ef0).ready entity=mon.1 client_cookie=22a27bbca849e0d0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb01259c700 1 -- 172.21.15.164:0/1728973270 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00400b820 con 0x7fb0140c4200 2020-11-20T12:02:31.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb01259c700 1 -- 172.21.15.164:0/1728973270 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb004000e90 con 0x7fb0140c4200 2020-11-20T12:02:31.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb01259c700 1 -- 172.21.15.164:0/1728973270 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00400bb90 con 0x7fb0140c4200 2020-11-20T12:02:31.368 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb019006700 1 -- 172.21.15.164:0/1728973270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c4200 msgr2=0x7fb0140bccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb019006700 1 --2- 172.21.15.164:0/1728973270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c4200 0x7fb0140bccf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fb004009a10 tx=0x7fb004006ef0).stop 2020-11-20T12:02:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb019006700 1 -- 172.21.15.164:0/1728973270 shutdown_connections 2020-11-20T12:02:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb019006700 1 --2- 172.21.15.164:0/1728973270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c4200 0x7fb0140bccf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb019006700 1 -- 172.21.15.164:0/1728973270 >> 172.21.15.164:0/1728973270 conn(0x7fb0140678e0 msgr2=0x7fb014067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb019006700 1 -- 172.21.15.164:0/1728973270 shutdown_connections 2020-11-20T12:02:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.359+0000 7fb019006700 1 -- 172.21.15.164:0/1728973270 wait complete. 2020-11-20T12:02:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.360+0000 7fb019006700 1 Processor -- start 2020-11-20T12:02:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb019006700 1 -- start start 2020-11-20T12:02:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb019006700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0140c0ba0 0x7fb014164860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb019006700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0140c4200 0x7fb01414f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb019006700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c45e0 0x7fb0141549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb019006700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014164d50 con 0x7fb0140c0ba0 2020-11-20T12:02:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb019006700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014147ef0 con 0x7fb0140c45e0 2020-11-20T12:02:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb019006700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01414dec0 con 0x7fb0140c4200 2020-11-20T12:02:31.372 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb01359e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c45e0 0x7fb0141549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.372 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb01359e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c45e0 0x7fb0141549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46268/0 (socket says 172.21.15.164:46268) 2020-11-20T12:02:31.372 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb01359e700 1 -- 172.21.15.164:0/3846403609 learned_addr learned my addr 172.21.15.164:0/3846403609 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:31.372 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb012d9d700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0140c0ba0 0x7fb014164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.372 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.361+0000 7fb00bfff700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0140c4200 0x7fb01414f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.373 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb01359e700 1 -- 172.21.15.164:0/3846403609 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0140c4200 msgr2=0x7fb01414f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.373 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb01359e700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0140c4200 0x7fb01414f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.373 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb01359e700 1 -- 172.21.15.164:0/3846403609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0140c0ba0 msgr2=0x7fb014164860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.373 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb01359e700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0140c0ba0 0x7fb014164860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb01359e700 1 -- 172.21.15.164:0/3846403609 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01414e160 con 0x7fb0140c45e0 2020-11-20T12:02:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb01359e700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c45e0 0x7fb0141549f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb00c00cac0 tx=0x7fb00c0013a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb00affd700 1 -- 172.21.15.164:0/3846403609 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00a550 con 0x7fb0140c45e0 2020-11-20T12:02:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb00affd700 1 -- 172.21.15.164:0/3846403609 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00a6b0 con 0x7fb0140c45e0 2020-11-20T12:02:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb019006700 1 -- 172.21.15.164:0/3846403609 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01414e400 con 0x7fb0140c45e0 2020-11-20T12:02:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb00affd700 1 -- 172.21.15.164:0/3846403609 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00aa30 con 0x7fb0140c45e0 2020-11-20T12:02:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.362+0000 7fb019006700 1 -- 172.21.15.164:0/3846403609 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb014152b00 con 0x7fb0140c45e0 2020-11-20T12:02:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.363+0000 7fb008ff9700 1 -- 172.21.15.164:0/3846403609 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe4004fd0 con 0x7fb0140c45e0 2020-11-20T12:02:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.363+0000 7fb00affd700 1 -- 172.21.15.164:0/3846403609 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb00c018020 con 0x7fb0140c45e0 2020-11-20T12:02:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.364+0000 7fb00affd700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faff00806a0 0x7faff0082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.364+0000 7fb00affd700 1 -- 172.21.15.164:0/3846403609 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb00c0a26b0 con 0x7fb0140c45e0 2020-11-20T12:02:31.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.364+0000 7fb012d9d700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faff00806a0 0x7faff0082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.365+0000 7fb012d9d700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faff00806a0 0x7faff0082b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb004006f30 tx=0x7fb004016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.376 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.368+0000 7fb00affd700 1 -- 172.21.15.164:0/3846403609 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb00c077040 con 0x7fb0140c45e0 2020-11-20T12:02:31.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.508+0000 7fb008ff9700 1 -- 172.21.15.164:0/3846403609 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fafe4002ad0 con 0x7faff00806a0 2020-11-20T12:02:31.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.508+0000 7fb00affd700 1 -- 172.21.15.164:0/3846403609 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fafe4002ad0 con 0x7faff00806a0 2020-11-20T12:02:31.514 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 -- 172.21.15.164:0/3846403609 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faff00806a0 msgr2=0x7faff0082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faff00806a0 0x7faff0082b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb004006f30 tx=0x7fb004016000).stop 2020-11-20T12:02:31.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 -- 172.21.15.164:0/3846403609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c45e0 msgr2=0x7fb0141549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.515 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c45e0 0x7fb0141549f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb00c00cac0 tx=0x7fb00c0013a0).stop 2020-11-20T12:02:31.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 -- 172.21.15.164:0/3846403609 shutdown_connections 2020-11-20T12:02:31.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7faff00806a0 0x7faff0082b60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0140c45e0 0x7fb0141549f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0140c0ba0 0x7fb014164860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 --2- 172.21.15.164:0/3846403609 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0140c4200 0x7fb01414f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.517 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 -- 172.21.15.164:0/3846403609 >> 172.21.15.164:0/3846403609 conn(0x7fb0140678e0 msgr2=0x7fb0140bdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:31.517 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 -- 172.21.15.164:0/3846403609 shutdown_connections 2020-11-20T12:02:31.517 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.510+0000 7fb008ff9700 1 -- 172.21.15.164:0/3846403609 wait complete. 2020-11-20T12:02:31.518 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 6 to deep-scrub 2020-11-20T12:02:31.526 INFO:tasks.ceph:Scrubbing osd.9 2020-11-20T12:02:31.527 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:31.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.636+0000 7fb41b155700 1 Processor -- start 2020-11-20T12:02:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.636+0000 7fb41b155700 1 -- start start 2020-11-20T12:02:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.637+0000 7fb41b155700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb41414e870 0x7fb4140c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.637+0000 7fb41b155700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41409d300 con 0x7fb414155330 2020-11-20T12:02:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.637+0000 7fb41b155700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb414151f70 con 0x7fb4140c4360 2020-11-20T12:02:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.637+0000 7fb41b155700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41409e8c0 con 0x7fb41414e870 2020-11-20T12:02:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.637+0000 7fb418ef1700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fb4140c4360 0x7fb41409e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56012/0 (socket says 172.21.15.164:56012) 2020-11-20T12:02:31.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.637+0000 7fb418ef1700 1 -- 172.21.15.164:0/4278757924 learned_addr learned my addr 172.21.15.164:0/4278757924 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:31.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.637+0000 7fb4196f2700 1 --2- 172.21.15.164:0/4278757924 >> v2:172.21.15.188:3300/0 conn(0x7fb41414e870 0x7fb4140c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.638+0000 7fb4137fe700 1 -- 172.21.15.164:0/4278757924 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843586000 0 0) 0x7fb414151f70 con 0x7fb4140c4360 2020-11-20T12:02:31.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.638+0000 7fb4137fe700 1 -- 172.21.15.164:0/4278757924 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f8003280 con 0x7fb4140c4360 2020-11-20T12:02:31.651 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.638+0000 7fb4196f2700 1 -- 172.21.15.164:0/4278757924 >> v1:172.21.15.164:6789/0 conn(0x7fb4140c4360 legacy=0x7fb41409e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.638+0000 7fb4196f2700 1 -- 172.21.15.164:0/4278757924 >> v1:172.21.15.36:6789/0 conn(0x7fb414155330 legacy=0x7fb41414e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.638+0000 7fb4196f2700 1 -- 172.21.15.164:0/4278757924 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41409d530 con 0x7fb41414e870 2020-11-20T12:02:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.638+0000 7fb4196f2700 1 --2- 172.21.15.164:0/4278757924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb41414e870 0x7fb4140c4740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb40c009ce0 tx=0x7fb40c009220).ready entity=mon.2 client_cookie=b16f592544d0b889 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.638+0000 7fb4137fe700 1 -- 172.21.15.164:0/4278757924 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c00bad0 con 0x7fb41414e870 2020-11-20T12:02:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.638+0000 7fb4137fe700 1 -- 172.21.15.164:0/4278757924 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c00bc30 con 0x7fb41414e870 2020-11-20T12:02:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.638+0000 7fb4137fe700 1 -- 172.21.15.164:0/4278757924 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c011400 con 0x7fb41414e870 2020-11-20T12:02:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.639+0000 7fb41b155700 1 -- 172.21.15.164:0/4278757924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb41414e870 msgr2=0x7fb4140c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.639+0000 7fb41b155700 1 --2- 172.21.15.164:0/4278757924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb41414e870 0x7fb4140c4740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb40c009ce0 tx=0x7fb40c009220).stop 2020-11-20T12:02:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.639+0000 7fb41b155700 1 -- 172.21.15.164:0/4278757924 shutdown_connections 2020-11-20T12:02:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.639+0000 7fb41b155700 1 --2- 172.21.15.164:0/4278757924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb41414e870 0x7fb4140c4740 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.639+0000 7fb41b155700 1 -- 172.21.15.164:0/4278757924 >> 172.21.15.164:0/4278757924 conn(0x7fb414068370 msgr2=0x7fb41407ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.639+0000 7fb41b155700 1 -- 172.21.15.164:0/4278757924 shutdown_connections 2020-11-20T12:02:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.639+0000 7fb41b155700 1 -- 172.21.15.164:0/4278757924 wait complete. 2020-11-20T12:02:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.640+0000 7fb41b155700 1 Processor -- start 2020-11-20T12:02:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.640+0000 7fb41b155700 1 -- start start 2020-11-20T12:02:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb41b155700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4140c4360 0x7fb414157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb41b155700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb41414e870 0x7fb4141638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb41b155700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb414155330 0x7fb414156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb41b155700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb414158610 con 0x7fb414155330 2020-11-20T12:02:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb41b155700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb414158370 con 0x7fb4140c4360 2020-11-20T12:02:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb41b155700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4141528a0 con 0x7fb41414e870 2020-11-20T12:02:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb418ef1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4140c4360 0x7fb414157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb418ef1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4140c4360 0x7fb414157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46278/0 (socket says 172.21.15.164:46278) 2020-11-20T12:02:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb418ef1700 1 -- 172.21.15.164:0/1056036960 learned_addr learned my addr 172.21.15.164:0/1056036960 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb4196f2700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb414155330 0x7fb414156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb413fff700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb41414e870 0x7fb4141638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb418ef1700 1 -- 172.21.15.164:0/1056036960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb41414e870 msgr2=0x7fb4141638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb418ef1700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb41414e870 0x7fb4141638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb418ef1700 1 -- 172.21.15.164:0/1056036960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb414155330 msgr2=0x7fb414156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb418ef1700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb414155330 0x7fb414156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb418ef1700 1 -- 172.21.15.164:0/1056036960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb414152b40 con 0x7fb4140c4360 2020-11-20T12:02:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb418ef1700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4140c4360 0x7fb414157d50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fb40800c740 tx=0x7fb408007b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb410ff9700 1 -- 172.21.15.164:0/1056036960 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080072e0 con 0x7fb4140c4360 2020-11-20T12:02:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb410ff9700 1 -- 172.21.15.164:0/1056036960 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408007440 con 0x7fb4140c4360 2020-11-20T12:02:31.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb414152de0 con 0x7fb4140c4360 2020-11-20T12:02:31.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.641+0000 7fb410ff9700 1 -- 172.21.15.164:0/1056036960 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408005860 con 0x7fb4140c4360 2020-11-20T12:02:31.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.642+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb414164360 con 0x7fb4140c4360 2020-11-20T12:02:31.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.642+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb414161510 con 0x7fb4140c4360 2020-11-20T12:02:31.659 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.643+0000 7fb410ff9700 1 -- 172.21.15.164:0/1056036960 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb408010070 con 0x7fb4140c4360 2020-11-20T12:02:31.660 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.643+0000 7fb410ff9700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb3ec080670 0x7fb3ec082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.660 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.644+0000 7fb410ff9700 1 -- 172.21.15.164:0/1056036960 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb4080a28d0 con 0x7fb4140c4360 2020-11-20T12:02:31.660 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.644+0000 7fb413fff700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb3ec080670 0x7fb3ec082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.660 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.644+0000 7fb410ff9700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] conn(0x7fb3ec0893a0 0x7fb3ec08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.660 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.644+0000 7fb410ff9700 1 -- 172.21.15.164:0/1056036960 --> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3ec08be20 con 0x7fb3ec0893a0 2020-11-20T12:02:31.661 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.644+0000 7fb410ff9700 1 -- 172.21.15.164:0/1056036960 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4080a2bc0 con 0x7fb4140c4360 2020-11-20T12:02:31.661 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.644+0000 7fb4196f2700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] conn(0x7fb3ec0893a0 0x7fb3ec08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.661 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.644+0000 7fb413fff700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb3ec080670 0x7fb3ec082b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb4141542f0 tx=0x7fb400009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.661 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.644+0000 7fb4196f2700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] conn(0x7fb3ec0893a0 0x7fb3ec08b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.661 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.645+0000 7fb410ff9700 1 -- 172.21.15.164:0/1056036960 <== osd.9 v2:172.21.15.164:6826/23232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fb3ec08be20 con 0x7fb3ec0893a0 2020-11-20T12:02:31.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 --> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb414069b70 con 0x7fb3ec0893a0 2020-11-20T12:02:31.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb410ff9700 1 -- 172.21.15.164:0/1056036960 <== osd.9 v2:172.21.15.164:6826/23232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb414069b70 con 0x7fb3ec0893a0 2020-11-20T12:02:31.663 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] conn(0x7fb3ec0893a0 msgr2=0x7fb3ec08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:6826/23232,v1:172.21.15.164:6827/23232] conn(0x7fb3ec0893a0 0x7fb3ec08b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb3ec080670 msgr2=0x7fb3ec082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb3ec080670 0x7fb3ec082b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb4141542f0 tx=0x7fb400009040).stop 2020-11-20T12:02:31.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4140c4360 msgr2=0x7fb414157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.664 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 --2- 172.21.15.164:0/1056036960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4140c4360 0x7fb414157d50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fb40800c740 tx=0x7fb408007b00).stop 2020-11-20T12:02:31.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb4196f2700 1 -- 172.21.15.164:0/1056036960 reap_dead start 2020-11-20T12:02:31.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 shutdown_connections 2020-11-20T12:02:31.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 >> 172.21.15.164:0/1056036960 conn(0x7fb414068370 msgr2=0x7fb4140c4740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:31.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 shutdown_connections 2020-11-20T12:02:31.665 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.658+0000 7fb41b155700 1 -- 172.21.15.164:0/1056036960 wait complete. 2020-11-20T12:02:31.666 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:31.666 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:31.666 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:31.674 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2020-11-20T12:02:31.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.780+0000 7fcf37f8f700 1 Processor -- start 2020-11-20T12:02:31.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.780+0000 7fcf37f8f700 1 -- start start 2020-11-20T12:02:31.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.781+0000 7fcf37f8f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcf300c4470 0x7fcf300c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.781+0000 7fcf37f8f700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcf300bccf0 0x7fcf300c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.781+0000 7fcf37f8f700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf301555a0 con 0x7fcf300c10e0 2020-11-20T12:02:31.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.781+0000 7fcf37f8f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf301517d0 con 0x7fcf300c4470 2020-11-20T12:02:31.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.781+0000 7fcf37f8f700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf30151a70 con 0x7fcf300bccf0 2020-11-20T12:02:31.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.781+0000 7fcf3552a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcf300bccf0 0x7fcf300c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.781+0000 7fcf3652c700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fcf300c10e0 0x7fcf300bf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56030/0 (socket says 172.21.15.164:56030) 2020-11-20T12:02:31.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.781+0000 7fcf3652c700 1 -- 172.21.15.164:0/3139189622 learned_addr learned my addr 172.21.15.164:0/3139189622 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:31.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.781+0000 7fcf35d2b700 1 --2- 172.21.15.164:0/3139189622 >> v2:172.21.15.36:3300/0 conn(0x7fcf300c4470 0x7fcf300c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf3552a700 1 -- 172.21.15.164:0/3139189622 >> v2:172.21.15.36:3300/0 conn(0x7fcf300c4470 msgr2=0x7fcf300c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:31.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf3552a700 1 --2- 172.21.15.164:0/3139189622 >> v2:172.21.15.36:3300/0 conn(0x7fcf300c4470 0x7fcf300c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf3552a700 1 -- 172.21.15.164:0/3139189622 >> v1:172.21.15.164:6789/0 conn(0x7fcf300c10e0 legacy=0x7fcf300bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf3552a700 1 -- 172.21.15.164:0/3139189622 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30151d10 con 0x7fcf300bccf0 2020-11-20T12:02:31.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf34d29700 1 -- 172.21.15.164:0/3139189622 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078734840 0 0) 0x7fcf301555a0 con 0x7fcf300c10e0 2020-11-20T12:02:31.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf35d2b700 1 --2- 172.21.15.164:0/3139189622 >> v2:172.21.15.36:3300/0 conn(0x7fcf300c4470 0x7fcf300c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:31.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf3552a700 1 --2- 172.21.15.164:0/3139189622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300bccf0 0x7fcf300c0bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fcf300c4d40 tx=0x7fcf20006e30).ready entity=mon.1 client_cookie=1f5d159632f4a2d4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf34d29700 1 -- 172.21.15.164:0/3139189622 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20009840 con 0x7fcf300bccf0 2020-11-20T12:02:31.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf34d29700 1 -- 172.21.15.164:0/3139189622 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20000e90 con 0x7fcf300bccf0 2020-11-20T12:02:31.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf34d29700 1 -- 172.21.15.164:0/3139189622 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20009bb0 con 0x7fcf300bccf0 2020-11-20T12:02:31.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf37f8f700 1 -- 172.21.15.164:0/3139189622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300bccf0 msgr2=0x7fcf300c0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf37f8f700 1 --2- 172.21.15.164:0/3139189622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300bccf0 0x7fcf300c0bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fcf300c4d40 tx=0x7fcf20006e30).stop 2020-11-20T12:02:31.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf37f8f700 1 -- 172.21.15.164:0/3139189622 shutdown_connections 2020-11-20T12:02:31.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf37f8f700 1 --2- 172.21.15.164:0/3139189622 >> v2:172.21.15.36:3300/0 conn(0x7fcf300c4470 0x7fcf300c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf37f8f700 1 --2- 172.21.15.164:0/3139189622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300bccf0 0x7fcf300c0bf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf37f8f700 1 -- 172.21.15.164:0/3139189622 >> 172.21.15.164:0/3139189622 conn(0x7fcf300683b0 msgr2=0x7fcf30061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:31.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf37f8f700 1 -- 172.21.15.164:0/3139189622 shutdown_connections 2020-11-20T12:02:31.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.782+0000 7fcf37f8f700 1 -- 172.21.15.164:0/3139189622 wait complete. 2020-11-20T12:02:31.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.783+0000 7fcf37f8f700 1 Processor -- start 2020-11-20T12:02:31.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.783+0000 7fcf37f8f700 1 -- start start 2020-11-20T12:02:31.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.784+0000 7fcf37f8f700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf300bccf0 0x7fcf30160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.784+0000 7fcf37f8f700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300c10e0 0x7fcf3014f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.784+0000 7fcf37f8f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf300c4470 0x7fcf301125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.784+0000 7fcf37f8f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30163a70 con 0x7fcf300c4470 2020-11-20T12:02:31.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.784+0000 7fcf37f8f700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30163ca0 con 0x7fcf300c10e0 2020-11-20T12:02:31.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.784+0000 7fcf37f8f700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30163f40 con 0x7fcf300bccf0 2020-11-20T12:02:31.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.784+0000 7fcf3552a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300c10e0 0x7fcf3014f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.784+0000 7fcf3552a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300c10e0 0x7fcf3014f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46298/0 (socket says 172.21.15.164:46298) 2020-11-20T12:02:31.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.784+0000 7fcf3552a700 1 -- 172.21.15.164:0/2639220119 learned_addr learned my addr 172.21.15.164:0/2639220119 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:31.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf35d2b700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf300bccf0 0x7fcf30160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf3652c700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf300c4470 0x7fcf301125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf3552a700 1 -- 172.21.15.164:0/2639220119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf300bccf0 msgr2=0x7fcf30160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf3552a700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf300bccf0 0x7fcf30160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf3552a700 1 -- 172.21.15.164:0/2639220119 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf300c4470 msgr2=0x7fcf301125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.798 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf3552a700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf300c4470 0x7fcf301125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.798 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf3552a700 1 -- 172.21.15.164:0/2639220119 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf301641e0 con 0x7fcf300c10e0 2020-11-20T12:02:31.798 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf3652c700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf300c4470 0x7fcf301125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:31.798 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf3552a700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300c10e0 0x7fcf3014f000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fcf20009ce0 tx=0x7fcf20015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf1dffb700 1 -- 172.21.15.164:0/2639220119 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20011d00 con 0x7fcf300c10e0 2020-11-20T12:02:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf1dffb700 1 -- 172.21.15.164:0/2639220119 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20011e60 con 0x7fcf300c10e0 2020-11-20T12:02:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf37f8f700 1 -- 172.21.15.164:0/2639220119 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf30164480 con 0x7fcf300c10e0 2020-11-20T12:02:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf1dffb700 1 -- 172.21.15.164:0/2639220119 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2001e690 con 0x7fcf300c10e0 2020-11-20T12:02:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.785+0000 7fcf37f8f700 1 -- 172.21.15.164:0/2639220119 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3014f4f0 con 0x7fcf300c10e0 2020-11-20T12:02:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.786+0000 7fcf37f8f700 1 -- 172.21.15.164:0/2639220119 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf300c0ca0 con 0x7fcf300c10e0 2020-11-20T12:02:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.787+0000 7fcf1dffb700 1 -- 172.21.15.164:0/2639220119 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fcf2001a040 con 0x7fcf300c10e0 2020-11-20T12:02:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.787+0000 7fcf1dffb700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcf08080670 0x7fcf08082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.787+0000 7fcf1dffb700 1 -- 172.21.15.164:0/2639220119 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fcf200a4720 con 0x7fcf300c10e0 2020-11-20T12:02:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.787+0000 7fcf35d2b700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcf08080670 0x7fcf08082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.788+0000 7fcf35d2b700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcf08080670 0x7fcf08082b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fcf2c00c900 tx=0x7fcf2c008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.790+0000 7fcf1dffb700 1 -- 172.21.15.164:0/2639220119 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fcf200790b0 con 0x7fcf300c10e0 2020-11-20T12:02:31.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.931+0000 7fcf37f8f700 1 -- 172.21.15.164:0/2639220119 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf301648e0 con 0x7fcf08080670 2020-11-20T12:02:31.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.931+0000 7fcf1dffb700 1 -- 172.21.15.164:0/2639220119 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcf301648e0 con 0x7fcf08080670 2020-11-20T12:02:31.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 -- 172.21.15.164:0/2639220119 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcf08080670 msgr2=0x7fcf08082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcf08080670 0x7fcf08082b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fcf2c00c900 tx=0x7fcf2c008040).stop 2020-11-20T12:02:31.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 -- 172.21.15.164:0/2639220119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300c10e0 msgr2=0x7fcf3014f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300c10e0 0x7fcf3014f000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fcf20009ce0 tx=0x7fcf20015000).stop 2020-11-20T12:02:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 -- 172.21.15.164:0/2639220119 shutdown_connections 2020-11-20T12:02:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcf08080670 0x7fcf08082b30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf300c4470 0x7fcf301125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf300bccf0 0x7fcf30160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 --2- 172.21.15.164:0/2639220119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf300c10e0 0x7fcf3014f000 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 -- 172.21.15.164:0/2639220119 >> 172.21.15.164:0/2639220119 conn(0x7fcf300683b0 msgr2=0x7fcf300c2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 -- 172.21.15.164:0/2639220119 shutdown_connections 2020-11-20T12:02:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:31.933+0000 7fcf37f8f700 1 -- 172.21.15.164:0/2639220119 wait complete. 2020-11-20T12:02:31.940 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 9 to deep-scrub 2020-11-20T12:02:31.949 INFO:tasks.ceph:Scrubbing osd.1 2020-11-20T12:02:31.949 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:32.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.059+0000 7f192a263700 1 Processor -- start 2020-11-20T12:02:32.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.059+0000 7f192a263700 1 -- start start 2020-11-20T12:02:32.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.059+0000 7f192a263700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1924155330 0x7f19240c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.059+0000 7f192a263700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f19240c2180 0x7f192414e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.059+0000 7f192a263700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192409d300 con 0x7f19240c4360 2020-11-20T12:02:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.059+0000 7f192a263700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192409e8c0 con 0x7f19240c2180 2020-11-20T12:02:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.059+0000 7f192a263700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192409f720 con 0x7f1924155330 2020-11-20T12:02:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1928800700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f19240c2180 0x7f192414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1923fff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f19240c4360 0x7f192409e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56042/0 (socket says 172.21.15.164:56042) 2020-11-20T12:02:32.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1923fff700 1 -- 172.21.15.164:0/3545604613 learned_addr learned my addr 172.21.15.164:0/3545604613 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:32.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f19237fe700 1 --2- 172.21.15.164:0/3545604613 >> v2:172.21.15.188:3300/0 conn(0x7f1924155330 0x7f19240c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1928800700 1 -- 172.21.15.164:0/3545604613 >> v2:172.21.15.188:3300/0 conn(0x7f1924155330 msgr2=0x7f19240c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:32.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1928800700 1 --2- 172.21.15.164:0/3545604613 >> v2:172.21.15.188:3300/0 conn(0x7f1924155330 0x7f19240c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1928800700 1 -- 172.21.15.164:0/3545604613 >> v1:172.21.15.164:6789/0 conn(0x7f19240c4360 legacy=0x7f192409e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1928800700 1 -- 172.21.15.164:0/3545604613 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924151f70 con 0x7f19240c2180 2020-11-20T12:02:32.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1922ffd700 1 -- 172.21.15.164:0/3545604613 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768053579 0 0) 0x7f192409d300 con 0x7f19240c4360 2020-11-20T12:02:32.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1928800700 1 --2- 172.21.15.164:0/3545604613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240c2180 0x7f192414e160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f19240687a0 tx=0x7f191c009220).ready entity=mon.1 client_cookie=8ba04e0c64494fe1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1922ffd700 1 -- 172.21.15.164:0/3545604613 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00ba90 con 0x7f19240c2180 2020-11-20T12:02:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1922ffd700 1 -- 172.21.15.164:0/3545604613 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00bbf0 con 0x7f19240c2180 2020-11-20T12:02:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.060+0000 7f1922ffd700 1 -- 172.21.15.164:0/3545604613 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c011400 con 0x7f19240c2180 2020-11-20T12:02:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.061+0000 7f192a263700 1 -- 172.21.15.164:0/3545604613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240c2180 msgr2=0x7f192414e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.061+0000 7f192a263700 1 --2- 172.21.15.164:0/3545604613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240c2180 0x7f192414e160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f19240687a0 tx=0x7f191c009220).stop 2020-11-20T12:02:32.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.061+0000 7f192a263700 1 -- 172.21.15.164:0/3545604613 shutdown_connections 2020-11-20T12:02:32.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.061+0000 7f192a263700 1 --2- 172.21.15.164:0/3545604613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240c2180 0x7f192414e160 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.061+0000 7f192a263700 1 --2- 172.21.15.164:0/3545604613 >> v2:172.21.15.188:3300/0 conn(0x7f1924155330 0x7f19240c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.061+0000 7f192a263700 1 -- 172.21.15.164:0/3545604613 >> 172.21.15.164:0/3545604613 conn(0x7f1924068370 msgr2=0x7f192407ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:32.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.061+0000 7f192a263700 1 -- 172.21.15.164:0/3545604613 shutdown_connections 2020-11-20T12:02:32.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.061+0000 7f192a263700 1 -- 172.21.15.164:0/3545604613 wait complete. 2020-11-20T12:02:32.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.062+0000 7f192a263700 1 Processor -- start 2020-11-20T12:02:32.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.062+0000 7f192a263700 1 -- start start 2020-11-20T12:02:32.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f192a263700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240c2180 0x7f19241563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f192a263700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19240c4360 0x7f1924151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f192a263700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1924155330 0x7f192414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f192a263700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924158790 con 0x7f1924155330 2020-11-20T12:02:32.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f192a263700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924156990 con 0x7f19240c2180 2020-11-20T12:02:32.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f192a263700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924156c30 con 0x7f19240c4360 2020-11-20T12:02:32.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1923fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240c2180 0x7f19241563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1923fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240c2180 0x7f19241563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46308/0 (socket says 172.21.15.164:46308) 2020-11-20T12:02:32.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1923fff700 1 -- 172.21.15.164:0/3539012824 learned_addr learned my addr 172.21.15.164:0/3539012824 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:32.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f19237fe700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19240c4360 0x7f1924151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1928800700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1924155330 0x7f192414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1923fff700 1 -- 172.21.15.164:0/3539012824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19240c4360 msgr2=0x7f1924151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1923fff700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19240c4360 0x7f1924151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1923fff700 1 -- 172.21.15.164:0/3539012824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1924155330 msgr2=0x7f192414b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1923fff700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1924155330 0x7f192414b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1923fff700 1 -- 172.21.15.164:0/3539012824 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924156ed0 con 0x7f19240c2180 2020-11-20T12:02:32.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1928800700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1924155330 0x7f192414b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:32.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1923fff700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240c2180 0x7f19241563b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f191400c7c0 tx=0x7f1914007b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.063+0000 7f1903fff700 1 -- 172.21.15.164:0/3539012824 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914007320 con 0x7f19240c2180 2020-11-20T12:02:32.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.064+0000 7f1903fff700 1 -- 172.21.15.164:0/3539012824 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1914007480 con 0x7f19240c2180 2020-11-20T12:02:32.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.064+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1924157170 con 0x7f19240c2180 2020-11-20T12:02:32.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.064+0000 7f1903fff700 1 -- 172.21.15.164:0/3539012824 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914005840 con 0x7f19240c2180 2020-11-20T12:02:32.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.064+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19240bedf0 con 0x7f19240c2180 2020-11-20T12:02:32.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.064+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1924069b70 con 0x7f19240c2180 2020-11-20T12:02:32.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.065+0000 7f1903fff700 1 -- 172.21.15.164:0/3539012824 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1914010030 con 0x7f19240c2180 2020-11-20T12:02:32.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.065+0000 7f1903fff700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f18fc080670 0x7f18fc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.066+0000 7f1903fff700 1 -- 172.21.15.164:0/3539012824 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f19140a2f40 con 0x7f19240c2180 2020-11-20T12:02:32.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.066+0000 7f19237fe700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f18fc080670 0x7f18fc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.066+0000 7f1903fff700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] conn(0x7f18fc0893a0 0x7f18fc08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.066+0000 7f1903fff700 1 -- 172.21.15.164:0/3539012824 --> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18fc08be20 con 0x7f18fc0893a0 2020-11-20T12:02:32.083 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.066+0000 7f1903fff700 1 -- 172.21.15.164:0/3539012824 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19140a32b0 con 0x7f19240c2180 2020-11-20T12:02:32.083 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.066+0000 7f19237fe700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f18fc080670 0x7f18fc082b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f1924156080 tx=0x7f1918006e30).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.083 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.066+0000 7f1928800700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] conn(0x7f18fc0893a0 0x7f18fc08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.083 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.067+0000 7f1928800700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] conn(0x7f18fc0893a0 0x7f18fc08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.083 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.068+0000 7f1903fff700 1 -- 172.21.15.164:0/3539012824 <== osd.1 v2:172.21.15.36:6800/23019 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f18fc08be20 con 0x7f18fc0893a0 2020-11-20T12:02:32.084 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.080+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 --> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f192405d4e0 con 0x7f18fc0893a0 2020-11-20T12:02:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f1903fff700 1 -- 172.21.15.164:0/3539012824 <== osd.1 v2:172.21.15.36:6800/23019 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f192405d4e0 con 0x7f18fc0893a0 2020-11-20T12:02:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 >> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] conn(0x7f18fc0893a0 msgr2=0x7f18fc08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f192a263700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.36:6800/23019,v1:172.21.15.36:6801/23019] conn(0x7f18fc0893a0 0x7f18fc08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f18fc080670 msgr2=0x7f18fc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f192a263700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f18fc080670 0x7f18fc082b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f1924156080 tx=0x7f1918006e30).stop 2020-11-20T12:02:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240c2180 msgr2=0x7f19241563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f192a263700 1 --2- 172.21.15.164:0/3539012824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19240c2180 0x7f19241563b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f191400c7c0 tx=0x7f1914007b00).stop 2020-11-20T12:02:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f1928800700 1 -- 172.21.15.164:0/3539012824 reap_dead start 2020-11-20T12:02:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 shutdown_connections 2020-11-20T12:02:32.088 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 >> 172.21.15.164:0/3539012824 conn(0x7f1924068370 msgr2=0x7f19240c2730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:32.088 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 shutdown_connections 2020-11-20T12:02:32.088 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.081+0000 7f192a263700 1 -- 172.21.15.164:0/3539012824 wait complete. 2020-11-20T12:02:32.088 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:32.089 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:32.089 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:32.097 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2020-11-20T12:02:32.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.204+0000 7f08a56f2700 1 Processor -- start 2020-11-20T12:02:32.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.204+0000 7f08a56f2700 1 -- start start 2020-11-20T12:02:32.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f08a56f2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f08a01544c0 0x7f08a00c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f08a56f2700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f08a00c2460 0x7f08a0150a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f08a56f2700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a00c3e50 con 0x7f08a0150640 2020-11-20T12:02:32.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f08a56f2700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a00c28f0 con 0x7f08a00c2460 2020-11-20T12:02:32.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f08a56f2700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a0151c60 con 0x7f08a01544c0 2020-11-20T12:02:32.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089f7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f08a01544c0 0x7f08a00c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089f7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f08a01544c0 0x7f08a00c1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46320/0 (socket says 172.21.15.164:46320) 2020-11-20T12:02:32.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089f7fe700 1 -- 172.21.15.164:0/3222213585 learned_addr learned my addr 172.21.15.164:0/3222213585 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:32.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f08a4ef1700 1 --2- 172.21.15.164:0/3222213585 >> v2:172.21.15.36:3300/0 conn(0x7f08a00c2460 0x7f08a0150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089f7fe700 1 -- 172.21.15.164:0/3222213585 >> v2:172.21.15.36:3300/0 conn(0x7f08a00c2460 msgr2=0x7f08a0150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:32.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089f7fe700 1 --2- 172.21.15.164:0/3222213585 >> v2:172.21.15.36:3300/0 conn(0x7f08a00c2460 0x7f08a0150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089f7fe700 1 -- 172.21.15.164:0/3222213585 >> v1:172.21.15.36:6789/0 conn(0x7f08a0150640 legacy=0x7f08a00c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:32.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089f7fe700 1 -- 172.21.15.164:0/3222213585 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a00c40e0 con 0x7f08a01544c0 2020-11-20T12:02:32.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089f7fe700 1 --2- 172.21.15.164:0/3222213585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a01544c0 0x7f08a00c1f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f08a005c550 tx=0x7f0894006ef0).ready entity=mon.1 client_cookie=5ac3631c38339f70 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089effd700 1 -- 172.21.15.164:0/3222213585 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400b8b0 con 0x7f08a01544c0 2020-11-20T12:02:32.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089effd700 1 -- 172.21.15.164:0/3222213585 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0894000e90 con 0x7f08a01544c0 2020-11-20T12:02:32.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.205+0000 7f089effd700 1 -- 172.21.15.164:0/3222213585 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400bc20 con 0x7f08a01544c0 2020-11-20T12:02:32.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.206+0000 7f08a56f2700 1 -- 172.21.15.164:0/3222213585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a01544c0 msgr2=0x7f08a00c1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.206+0000 7f08a56f2700 1 --2- 172.21.15.164:0/3222213585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a01544c0 0x7f08a00c1f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f08a005c550 tx=0x7f0894006ef0).stop 2020-11-20T12:02:32.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.206+0000 7f08a56f2700 1 -- 172.21.15.164:0/3222213585 shutdown_connections 2020-11-20T12:02:32.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.206+0000 7f08a56f2700 1 --2- 172.21.15.164:0/3222213585 >> v2:172.21.15.36:3300/0 conn(0x7f08a00c2460 0x7f08a0150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.206+0000 7f08a56f2700 1 --2- 172.21.15.164:0/3222213585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a01544c0 0x7f08a00c1f70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.206+0000 7f08a56f2700 1 -- 172.21.15.164:0/3222213585 >> 172.21.15.164:0/3222213585 conn(0x7f08a007ffb0 msgr2=0x7f08a00803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:32.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.206+0000 7f08a56f2700 1 -- 172.21.15.164:0/3222213585 shutdown_connections 2020-11-20T12:02:32.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.206+0000 7f08a56f2700 1 -- 172.21.15.164:0/3222213585 wait complete. 2020-11-20T12:02:32.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.207+0000 7f08a56f2700 1 Processor -- start 2020-11-20T12:02:32.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.207+0000 7f08a56f2700 1 -- start start 2020-11-20T12:02:32.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f08a56f2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a00c2460 0x7f08a00c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f08a56f2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08a0150640 0x7f08a00c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f08a56f2700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08a01544c0 0x7f08a0155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f08a56f2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0160db0 con 0x7f08a0150640 2020-11-20T12:02:32.222 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f08a56f2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0161050 con 0x7f08a00c2460 2020-11-20T12:02:32.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f08a56f2700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00c6c70 con 0x7f08a01544c0 2020-11-20T12:02:32.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f089ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a00c2460 0x7f08a00c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f089ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a00c2460 0x7f08a00c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46324/0 (socket says 172.21.15.164:46324) 2020-11-20T12:02:32.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f089ffff700 1 -- 172.21.15.164:0/1114726263 learned_addr learned my addr 172.21.15.164:0/1114726263 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:32.223 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f089f7fe700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08a0150640 0x7f08a00c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.224 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f08a4ef1700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08a01544c0 0x7f08a0155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.224 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f089ffff700 1 -- 172.21.15.164:0/1114726263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08a01544c0 msgr2=0x7f08a0155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.224 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f089ffff700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08a01544c0 0x7f08a0155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f089ffff700 1 -- 172.21.15.164:0/1114726263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08a0150640 msgr2=0x7f08a00c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f089ffff700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08a0150640 0x7f08a00c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f089ffff700 1 -- 172.21.15.164:0/1114726263 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a00c6f10 con 0x7f08a00c2460 2020-11-20T12:02:32.225 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f089ffff700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a00c2460 0x7f08a00c7650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f0890009730 tx=0x7f0890006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f087ffff700 1 -- 172.21.15.164:0/1114726263 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000d520 con 0x7f08a00c2460 2020-11-20T12:02:32.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f087ffff700 1 -- 172.21.15.164:0/1114726263 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089000d6a0 con 0x7f08a00c2460 2020-11-20T12:02:32.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f08a56f2700 1 -- 172.21.15.164:0/1114726263 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a00c6560 con 0x7f08a00c2460 2020-11-20T12:02:32.226 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.208+0000 7f087ffff700 1 -- 172.21.15.164:0/1114726263 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000da60 con 0x7f08a00c2460 2020-11-20T12:02:32.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.209+0000 7f08a56f2700 1 -- 172.21.15.164:0/1114726263 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a0150be0 con 0x7f08a00c2460 2020-11-20T12:02:32.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.209+0000 7f08a56f2700 1 -- 172.21.15.164:0/1114726263 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a01612f0 con 0x7f08a00c2460 2020-11-20T12:02:32.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.210+0000 7f087ffff700 1 -- 172.21.15.164:0/1114726263 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0890012440 con 0x7f08a00c2460 2020-11-20T12:02:32.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.211+0000 7f087ffff700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0878080670 0x7f0878082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.227 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.211+0000 7f089f7fe700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0878080670 0x7f0878082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.211+0000 7f087ffff700 1 -- 172.21.15.164:0/1114726263 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f08900a2a70 con 0x7f08a00c2460 2020-11-20T12:02:32.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.211+0000 7f089f7fe700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0878080670 0x7f0878082b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f08a005c550 tx=0x7f0894016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.228 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.214+0000 7f087ffff700 1 -- 172.21.15.164:0/1114726263 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f08a01612f0 con 0x7f08a00c2460 2020-11-20T12:02:32.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.355+0000 7f08a56f2700 1 -- 172.21.15.164:0/1114726263 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f08a01612f0 con 0x7f0878080670 2020-11-20T12:02:32.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.356+0000 7f087ffff700 1 -- 172.21.15.164:0/1114726263 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f08a01612f0 con 0x7f0878080670 2020-11-20T12:02:32.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 -- 172.21.15.164:0/1114726263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0878080670 msgr2=0x7f0878082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0878080670 0x7f0878082b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f08a005c550 tx=0x7f0894016000).stop 2020-11-20T12:02:32.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 -- 172.21.15.164:0/1114726263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a00c2460 msgr2=0x7f08a00c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a00c2460 0x7f08a00c7650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f0890009730 tx=0x7f0890006e30).stop 2020-11-20T12:02:32.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 -- 172.21.15.164:0/1114726263 shutdown_connections 2020-11-20T12:02:32.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0878080670 0x7f0878082b30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08a00c2460 0x7f08a00c7650 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08a01544c0 0x7f08a0155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 --2- 172.21.15.164:0/1114726263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08a0150640 0x7f08a00c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 -- 172.21.15.164:0/1114726263 >> 172.21.15.164:0/1114726263 conn(0x7f08a007ffb0 msgr2=0x7f08a014ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 -- 172.21.15.164:0/1114726263 shutdown_connections 2020-11-20T12:02:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.357+0000 7f08a56f2700 1 -- 172.21.15.164:0/1114726263 wait complete. 2020-11-20T12:02:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 1 to deep-scrub 2020-11-20T12:02:32.373 INFO:tasks.ceph:Scrubbing osd.4 2020-11-20T12:02:32.373 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:32.488 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.483+0000 7f1412f6e700 1 Processor -- start 2020-11-20T12:02:32.488 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.483+0000 7f1412f6e700 1 -- start start 2020-11-20T12:02:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.484+0000 7f1412f6e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f140c0c4360 0x7f140c0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.484+0000 7f1412f6e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f140c0c2180 0x7f140c14e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.484+0000 7f1412f6e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c09d300 con 0x7f140c155330 2020-11-20T12:02:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.484+0000 7f1412f6e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c09e8c0 con 0x7f140c0c4360 2020-11-20T12:02:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.484+0000 7f1412f6e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c09f720 con 0x7f140c0c2180 2020-11-20T12:02:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.484+0000 7f141150b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f140c0c2180 0x7f140c14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.484+0000 7f140bfff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f140c155330 0x7f140c09e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56072/0 (socket says 172.21.15.164:56072) 2020-11-20T12:02:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.484+0000 7f140bfff700 1 -- 172.21.15.164:0/615348231 learned_addr learned my addr 172.21.15.164:0/615348231 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f1410d0a700 1 --2- 172.21.15.164:0/615348231 >> v2:172.21.15.36:3300/0 conn(0x7f140c0c4360 0x7f140c0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f141150b700 1 -- 172.21.15.164:0/615348231 >> v2:172.21.15.36:3300/0 conn(0x7f140c0c4360 msgr2=0x7f140c0c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f141150b700 1 --2- 172.21.15.164:0/615348231 >> v2:172.21.15.36:3300/0 conn(0x7f140c0c4360 0x7f140c0c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f141150b700 1 -- 172.21.15.164:0/615348231 >> v1:172.21.15.164:6789/0 conn(0x7f140c155330 legacy=0x7f140c09e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f140b7fe700 1 -- 172.21.15.164:0/615348231 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132619868 0 0) 0x7f140c09d300 con 0x7f140c155330 2020-11-20T12:02:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f141150b700 1 -- 172.21.15.164:0/615348231 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c151f70 con 0x7f140c0c2180 2020-11-20T12:02:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f141150b700 1 --2- 172.21.15.164:0/615348231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f140c0c2180 0x7f140c14e160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f140c0c77b0 tx=0x7f1404009220).ready entity=mon.1 client_cookie=2349dc927f396158 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f140b7fe700 1 -- 172.21.15.164:0/615348231 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400bc80 con 0x7f140c0c2180 2020-11-20T12:02:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f140b7fe700 1 -- 172.21.15.164:0/615348231 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140400bde0 con 0x7f140c0c2180 2020-11-20T12:02:32.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f140b7fe700 1 -- 172.21.15.164:0/615348231 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404011610 con 0x7f140c0c2180 2020-11-20T12:02:32.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f1412f6e700 1 -- 172.21.15.164:0/615348231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f140c0c2180 msgr2=0x7f140c14e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f1412f6e700 1 --2- 172.21.15.164:0/615348231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f140c0c2180 0x7f140c14e160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f140c0c77b0 tx=0x7f1404009220).stop 2020-11-20T12:02:32.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f1412f6e700 1 -- 172.21.15.164:0/615348231 shutdown_connections 2020-11-20T12:02:32.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f1412f6e700 1 --2- 172.21.15.164:0/615348231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f140c0c2180 0x7f140c14e160 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f1412f6e700 1 --2- 172.21.15.164:0/615348231 >> v2:172.21.15.36:3300/0 conn(0x7f140c0c4360 0x7f140c0c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f1412f6e700 1 -- 172.21.15.164:0/615348231 >> 172.21.15.164:0/615348231 conn(0x7f140c068370 msgr2=0x7f140c07ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:32.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.485+0000 7f1412f6e700 1 -- 172.21.15.164:0/615348231 shutdown_connections 2020-11-20T12:02:32.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.486+0000 7f1412f6e700 1 -- 172.21.15.164:0/615348231 wait complete. 2020-11-20T12:02:32.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.487+0000 7f1412f6e700 1 Processor -- start 2020-11-20T12:02:32.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.487+0000 7f1412f6e700 1 -- start start 2020-11-20T12:02:32.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.487+0000 7f1412f6e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f140c0c2180 0x7f140c0bd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.487+0000 7f1412f6e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f140c0c4360 0x7f140c0bdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.487+0000 7f1412f6e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f140c155330 0x7f140c0bed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.487+0000 7f1412f6e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0c0cc0 con 0x7f140c0c4360 2020-11-20T12:02:32.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.487+0000 7f1412f6e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0bd1e0 con 0x7f140c155330 2020-11-20T12:02:32.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.487+0000 7f1412f6e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c1649c0 con 0x7f140c0c2180 2020-11-20T12:02:32.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f141150b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f140c155330 0x7f140c0bed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f141150b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f140c155330 0x7f140c0bed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46342/0 (socket says 172.21.15.164:46342) 2020-11-20T12:02:32.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f141150b700 1 -- 172.21.15.164:0/2175012029 learned_addr learned my addr 172.21.15.164:0/2175012029 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:32.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f1410d0a700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f140c0c2180 0x7f140c0bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f140bfff700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f140c0c4360 0x7f140c0bdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f141150b700 1 -- 172.21.15.164:0/2175012029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f140c0c2180 msgr2=0x7f140c0bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f141150b700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f140c0c2180 0x7f140c0bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f141150b700 1 -- 172.21.15.164:0/2175012029 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f140c0c4360 msgr2=0x7f140c0bdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f141150b700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f140c0c4360 0x7f140c0bdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f141150b700 1 -- 172.21.15.164:0/2175012029 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0c0f20 con 0x7f140c155330 2020-11-20T12:02:32.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f140bfff700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f140c0c4360 0x7f140c0bdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:32.506 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f141150b700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f140c155330 0x7f140c0bed10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f14040090b0 tx=0x7f1404016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f1408ff9700 1 -- 172.21.15.164:0/2175012029 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404010780 con 0x7f140c155330 2020-11-20T12:02:32.507 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f1408ff9700 1 -- 172.21.15.164:0/2175012029 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14040108e0 con 0x7f140c155330 2020-11-20T12:02:32.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c0c11c0 con 0x7f140c155330 2020-11-20T12:02:32.508 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f1408ff9700 1 -- 172.21.15.164:0/2175012029 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404010c80 con 0x7f140c155330 2020-11-20T12:02:32.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.488+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c151250 con 0x7f140c155330 2020-11-20T12:02:32.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.489+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f140c05c850 con 0x7f140c155330 2020-11-20T12:02:32.509 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.490+0000 7f1408ff9700 1 -- 172.21.15.164:0/2175012029 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1404017070 con 0x7f140c155330 2020-11-20T12:02:32.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.490+0000 7f1408ff9700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f13e4080670 0x7f13e4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.510 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.490+0000 7f1408ff9700 1 -- 172.21.15.164:0/2175012029 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f14040a58f0 con 0x7f140c155330 2020-11-20T12:02:32.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.490+0000 7f1410d0a700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f13e4080670 0x7f13e4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.511 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.490+0000 7f1408ff9700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] conn(0x7f13e40893a0 0x7f13e408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.490+0000 7f1408ff9700 1 -- 172.21.15.164:0/2175012029 --> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13e408be20 con 0x7f13e40893a0 2020-11-20T12:02:32.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.490+0000 7f1408ff9700 1 -- 172.21.15.164:0/2175012029 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14040a5c60 con 0x7f140c155330 2020-11-20T12:02:32.512 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.491+0000 7f1410d0a700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f13e4080670 0x7f13e4082b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f140000b9b0 tx=0x7f1400008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.491+0000 7f140bfff700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] conn(0x7f13e40893a0 0x7f13e408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.513 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.491+0000 7f140bfff700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] conn(0x7f13e40893a0 0x7f13e408b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.492+0000 7f1408ff9700 1 -- 172.21.15.164:0/2175012029 <== osd.4 v2:172.21.15.36:6824/23020 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f13e408be20 con 0x7f13e40893a0 2020-11-20T12:02:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.504+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 --> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f140c069b70 con 0x7f13e40893a0 2020-11-20T12:02:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.505+0000 7f1408ff9700 1 -- 172.21.15.164:0/2175012029 <== osd.4 v2:172.21.15.36:6824/23020 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f140c069b70 con 0x7f13e40893a0 2020-11-20T12:02:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.505+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 >> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] conn(0x7f13e40893a0 msgr2=0x7f13e408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.505+0000 7f1412f6e700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.36:6824/23020,v1:172.21.15.36:6825/23020] conn(0x7f13e40893a0 0x7f13e408b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.518 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.506+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f13e4080670 msgr2=0x7f13e4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.518 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.506+0000 7f1412f6e700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f13e4080670 0x7f13e4082b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f140000b9b0 tx=0x7f1400008040).stop 2020-11-20T12:02:32.518 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.506+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f140c155330 msgr2=0x7f140c0bed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.519 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.506+0000 7f1412f6e700 1 --2- 172.21.15.164:0/2175012029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f140c155330 0x7f140c0bed10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f14040090b0 tx=0x7f1404016000).stop 2020-11-20T12:02:32.519 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.506+0000 7f141150b700 1 -- 172.21.15.164:0/2175012029 reap_dead start 2020-11-20T12:02:32.519 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.506+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 shutdown_connections 2020-11-20T12:02:32.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.506+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 >> 172.21.15.164:0/2175012029 conn(0x7f140c068370 msgr2=0x7f140c152590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:32.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.506+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 shutdown_connections 2020-11-20T12:02:32.520 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.506+0000 7f1412f6e700 1 -- 172.21.15.164:0/2175012029 wait complete. 2020-11-20T12:02:32.521 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:32.521 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:32.522 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:32.523 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2020-11-20T12:02:32.634 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.630+0000 7f2dbd553700 1 Processor -- start 2020-11-20T12:02:32.634 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.630+0000 7f2dbd553700 1 -- start start 2020-11-20T12:02:32.636 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2dbd553700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2db80bccf0 0x7f2db80c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.637 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2dbd553700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2db80bf680 0x7f2db80bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.637 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2dbd553700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db81555a0 con 0x7f2db80c4470 2020-11-20T12:02:32.637 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2dbd553700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80c0020 con 0x7f2db80bccf0 2020-11-20T12:02:32.637 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2dbd553700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db81517d0 con 0x7f2db80bf680 2020-11-20T12:02:32.637 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db67fc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2db80bccf0 0x7f2db80c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db67fc700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2db80bccf0 0x7f2db80c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46348/0 (socket says 172.21.15.164:46348) 2020-11-20T12:02:32.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db6ffd700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f2db80c4470 0x7f2db80c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56088/0 (socket says 172.21.15.164:56088) 2020-11-20T12:02:32.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db67fc700 1 -- 172.21.15.164:0/3651771928 learned_addr learned my addr 172.21.15.164:0/3651771928 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:32.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db77fe700 1 --2- 172.21.15.164:0/3651771928 >> v2:172.21.15.188:3300/0 conn(0x7f2db80bf680 0x7f2db80bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db67fc700 1 -- 172.21.15.164:0/3651771928 >> v2:172.21.15.188:3300/0 conn(0x7f2db80bf680 msgr2=0x7f2db80bfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:32.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db67fc700 1 --2- 172.21.15.164:0/3651771928 >> v2:172.21.15.188:3300/0 conn(0x7f2db80bf680 0x7f2db80bfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db67fc700 1 -- 172.21.15.164:0/3651771928 >> v1:172.21.15.164:6789/0 conn(0x7f2db80c4470 legacy=0x7f2db80c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db67fc700 1 -- 172.21.15.164:0/3651771928 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db8151a70 con 0x7f2db80bccf0 2020-11-20T12:02:32.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db67fc700 1 --2- 172.21.15.164:0/3651771928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bccf0 0x7f2db80c4850 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f2db80c51c0 tx=0x7f2da8006ef0).ready entity=mon.1 client_cookie=364202567647ab75 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db5ffb700 1 -- 172.21.15.164:0/3651771928 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800b8f0 con 0x7f2db80bccf0 2020-11-20T12:02:32.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db5ffb700 1 -- 172.21.15.164:0/3651771928 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8000e90 con 0x7f2db80bccf0 2020-11-20T12:02:32.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.631+0000 7f2db5ffb700 1 -- 172.21.15.164:0/3651771928 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800bc60 con 0x7f2db80bccf0 2020-11-20T12:02:32.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.632+0000 7f2dbd553700 1 -- 172.21.15.164:0/3651771928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bccf0 msgr2=0x7f2db80c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.632+0000 7f2dbd553700 1 --2- 172.21.15.164:0/3651771928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bccf0 0x7f2db80c4850 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f2db80c51c0 tx=0x7f2da8006ef0).stop 2020-11-20T12:02:32.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.632+0000 7f2dbd553700 1 -- 172.21.15.164:0/3651771928 shutdown_connections 2020-11-20T12:02:32.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.632+0000 7f2dbd553700 1 --2- 172.21.15.164:0/3651771928 >> v2:172.21.15.188:3300/0 conn(0x7f2db80bf680 0x7f2db80bfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.632+0000 7f2dbd553700 1 --2- 172.21.15.164:0/3651771928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bccf0 0x7f2db80c4850 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.632+0000 7f2dbd553700 1 -- 172.21.15.164:0/3651771928 >> 172.21.15.164:0/3651771928 conn(0x7f2db80683b0 msgr2=0x7f2db8061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:32.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.632+0000 7f2dbd553700 1 -- 172.21.15.164:0/3651771928 shutdown_connections 2020-11-20T12:02:32.642 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.632+0000 7f2dbd553700 1 -- 172.21.15.164:0/3651771928 wait complete. 2020-11-20T12:02:32.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.633+0000 7f2dbd553700 1 Processor -- start 2020-11-20T12:02:32.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.633+0000 7f2dbd553700 1 -- start start 2020-11-20T12:02:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2dbd553700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2db80bccf0 0x7f2db8157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2dbd553700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bf680 0x7f2db8153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2dbd553700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2db80c4470 0x7f2db8154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2dbd553700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db81618b0 con 0x7f2db80bccf0 2020-11-20T12:02:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2dbd553700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80c65f0 con 0x7f2db80bf680 2020-11-20T12:02:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2dbd553700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8161610 con 0x7f2db80c4470 2020-11-20T12:02:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2db67fc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bf680 0x7f2db8153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2db67fc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bf680 0x7f2db8153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46354/0 (socket says 172.21.15.164:46354) 2020-11-20T12:02:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2db67fc700 1 -- 172.21.15.164:0/1166658080 learned_addr learned my addr 172.21.15.164:0/1166658080 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2db6ffd700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2db80bccf0 0x7f2db8157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.647 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2db77fe700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2db80c4470 0x7f2db8154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.647 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2db67fc700 1 -- 172.21.15.164:0/1166658080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2db80c4470 msgr2=0x7f2db8154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.647 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2db67fc700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2db80c4470 0x7f2db8154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.647 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2db67fc700 1 -- 172.21.15.164:0/1166658080 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2db80bccf0 msgr2=0x7f2db8157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.648 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2db67fc700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2db80bccf0 0x7f2db8157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.648 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.634+0000 7f2db67fc700 1 -- 172.21.15.164:0/1166658080 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80c6850 con 0x7f2db80bf680 2020-11-20T12:02:32.648 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.635+0000 7f2db67fc700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bf680 0x7f2db8153b20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f2da8006f30 tx=0x7f2da8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.648 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.635+0000 7f2d9effd700 1 -- 172.21.15.164:0/1166658080 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8011c20 con 0x7f2db80bf680 2020-11-20T12:02:32.648 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.635+0000 7f2d9effd700 1 -- 172.21.15.164:0/1166658080 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8011da0 con 0x7f2db80bf680 2020-11-20T12:02:32.649 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.635+0000 7f2d9effd700 1 -- 172.21.15.164:0/1166658080 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da801c690 con 0x7f2db80bf680 2020-11-20T12:02:32.649 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.635+0000 7f2dbd553700 1 -- 172.21.15.164:0/1166658080 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db80c6af0 con 0x7f2db80bf680 2020-11-20T12:02:32.649 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.635+0000 7f2dbd553700 1 -- 172.21.15.164:0/1166658080 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db80c7230 con 0x7f2db80bf680 2020-11-20T12:02:32.649 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.636+0000 7f2dbd553700 1 -- 172.21.15.164:0/1166658080 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db80c31a0 con 0x7f2db80bf680 2020-11-20T12:02:32.649 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.636+0000 7f2d9effd700 1 -- 172.21.15.164:0/1166658080 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2da8017040 con 0x7f2db80bf680 2020-11-20T12:02:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.637+0000 7f2d9effd700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2d94080670 0x7f2d94082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.637+0000 7f2d9effd700 1 -- 172.21.15.164:0/1166658080 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2da80a43e0 con 0x7f2db80bf680 2020-11-20T12:02:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.637+0000 7f2db6ffd700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2d94080670 0x7f2d94082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.637+0000 7f2db6ffd700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2d94080670 0x7f2d94082b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2dac0046f0 tx=0x7f2dac000bc0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.640+0000 7f2d9effd700 1 -- 172.21.15.164:0/1166658080 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2da8078df0 con 0x7f2db80bf680 2020-11-20T12:02:32.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.780+0000 7f2dbd553700 1 -- 172.21.15.164:0/1166658080 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2db80c4900 con 0x7f2d94080670 2020-11-20T12:02:32.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.780+0000 7f2d9effd700 1 -- 172.21.15.164:0/1166658080 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2db80c4900 con 0x7f2d94080670 2020-11-20T12:02:32.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.781+0000 7f2dbd553700 1 -- 172.21.15.164:0/1166658080 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2d94080670 msgr2=0x7f2d94082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.781+0000 7f2dbd553700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2d94080670 0x7f2d94082b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2dac0046f0 tx=0x7f2dac000bc0).stop 2020-11-20T12:02:32.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.781+0000 7f2dbd553700 1 -- 172.21.15.164:0/1166658080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bf680 msgr2=0x7f2db8153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.781+0000 7f2dbd553700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bf680 0x7f2db8153b20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f2da8006f30 tx=0x7f2da8016000).stop 2020-11-20T12:02:32.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.781+0000 7f2dbd553700 1 -- 172.21.15.164:0/1166658080 shutdown_connections 2020-11-20T12:02:32.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.781+0000 7f2dbd553700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f2d94080670 0x7f2d94082b30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.781+0000 7f2dbd553700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2db80c4470 0x7f2db8154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.781+0000 7f2dbd553700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2db80bccf0 0x7f2db8157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.781+0000 7f2dbd553700 1 --2- 172.21.15.164:0/1166658080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2db80bf680 0x7f2db8153b20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.781+0000 7f2dbd553700 1 -- 172.21.15.164:0/1166658080 >> 172.21.15.164:0/1166658080 conn(0x7f2db80683b0 msgr2=0x7f2db814df70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:32.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.782+0000 7f2dbd553700 1 -- 172.21.15.164:0/1166658080 shutdown_connections 2020-11-20T12:02:32.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.782+0000 7f2dbd553700 1 -- 172.21.15.164:0/1166658080 wait complete. 2020-11-20T12:02:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 4 to deep-scrub 2020-11-20T12:02:32.798 INFO:tasks.ceph:Scrubbing osd.7 2020-11-20T12:02:32.798 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:32.912 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.909+0000 7fe5f94bb700 1 Processor -- start 2020-11-20T12:02:32.913 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.909+0000 7fe5f94bb700 1 -- start start 2020-11-20T12:02:32.915 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.909+0000 7fe5f94bb700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe5f40c2170 0x7fe5f40c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.915 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.909+0000 7fe5f94bb700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f40c2600 con 0x7fe5f4062480 2020-11-20T12:02:32.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.909+0000 7fe5f94bb700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f40c2870 con 0x7fe5f4062860 2020-11-20T12:02:32.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.909+0000 7fe5f94bb700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f40a0390 con 0x7fe5f40c2170 2020-11-20T12:02:32.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.909+0000 7fe5f2ffd700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fe5f4062480 0x7fe5f409fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56102/0 (socket says 172.21.15.164:56102) 2020-11-20T12:02:32.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f2ffd700 1 -- 172.21.15.164:0/84047690 learned_addr learned my addr 172.21.15.164:0/84047690 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:32.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f37fe700 1 --2- 172.21.15.164:0/84047690 >> v2:172.21.15.36:3300/0 conn(0x7fe5f40c2170 0x7fe5f40c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f1ffb700 1 -- 172.21.15.164:0/84047690 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831565143 0 0) 0x7fe5f40c2600 con 0x7fe5f4062480 2020-11-20T12:02:32.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f1ffb700 1 -- 172.21.15.164:0/84047690 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e0003280 con 0x7fe5f4062480 2020-11-20T12:02:32.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f1ffb700 1 -- 172.21.15.164:0/84047690 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830879451 0 0) 0x7fe5f40c2870 con 0x7fe5f4062860 2020-11-20T12:02:32.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f1ffb700 1 -- 172.21.15.164:0/84047690 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5f40c2600 con 0x7fe5f4062860 2020-11-20T12:02:32.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f1ffb700 1 -- 172.21.15.164:0/84047690 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4104139346 0 0) 0x7fe5e0003280 con 0x7fe5f4062480 2020-11-20T12:02:32.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f37fe700 1 -- 172.21.15.164:0/84047690 >> v1:172.21.15.188:6789/0 conn(0x7fe5f4062860 legacy=0x7fe5f40c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f37fe700 1 -- 172.21.15.164:0/84047690 >> v1:172.21.15.164:6789/0 conn(0x7fe5f4062480 legacy=0x7fe5f409fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f37fe700 1 -- 172.21.15.164:0/84047690 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f40c2b10 con 0x7fe5f40c2170 2020-11-20T12:02:32.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f37fe700 1 --2- 172.21.15.164:0/84047690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5f40c2170 0x7fe5f40c48e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fe5ec009ce0 tx=0x7fe5ec009220).ready entity=mon.0 client_cookie=5c70007f88a2c8c5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f1ffb700 1 -- 172.21.15.164:0/84047690 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8001520 con 0x7fe5f40c2170 2020-11-20T12:02:32.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f1ffb700 1 -- 172.21.15.164:0/84047690 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec00b710 con 0x7fe5f40c2170 2020-11-20T12:02:32.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.910+0000 7fe5f1ffb700 1 -- 172.21.15.164:0/84047690 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00ba90 con 0x7fe5f40c2170 2020-11-20T12:02:32.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.911+0000 7fe5f94bb700 1 -- 172.21.15.164:0/84047690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5f40c2170 msgr2=0x7fe5f40c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.911+0000 7fe5f94bb700 1 --2- 172.21.15.164:0/84047690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5f40c2170 0x7fe5f40c48e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fe5ec009ce0 tx=0x7fe5ec009220).stop 2020-11-20T12:02:32.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.911+0000 7fe5f94bb700 1 -- 172.21.15.164:0/84047690 shutdown_connections 2020-11-20T12:02:32.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.911+0000 7fe5f94bb700 1 --2- 172.21.15.164:0/84047690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5f40c2170 0x7fe5f40c48e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.911+0000 7fe5f94bb700 1 -- 172.21.15.164:0/84047690 >> 172.21.15.164:0/84047690 conn(0x7fe5f4068370 msgr2=0x7fe5f407ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:32.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.911+0000 7fe5f94bb700 1 -- 172.21.15.164:0/84047690 shutdown_connections 2020-11-20T12:02:32.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.911+0000 7fe5f94bb700 1 -- 172.21.15.164:0/84047690 wait complete. 2020-11-20T12:02:32.923 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.912+0000 7fe5f94bb700 1 Processor -- start 2020-11-20T12:02:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.912+0000 7fe5f94bb700 1 -- start start 2020-11-20T12:02:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f94bb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5f4062480 0x7fe5f414b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f94bb700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5f4062860 0x7fe5f40bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f94bb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5f40c2170 0x7fe5f4163dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f94bb700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f414bd10 con 0x7fe5f4062480 2020-11-20T12:02:32.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f94bb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f414c260 con 0x7fe5f40c2170 2020-11-20T12:02:32.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f94bb700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40bf370 con 0x7fe5f4062860 2020-11-20T12:02:32.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f37fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5f40c2170 0x7fe5f4163dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f37fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5f40c2170 0x7fe5f4163dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46370/0 (socket says 172.21.15.164:46370) 2020-11-20T12:02:32.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f37fe700 1 -- 172.21.15.164:0/2896024171 learned_addr learned my addr 172.21.15.164:0/2896024171 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:32.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f27fc700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5f4062860 0x7fe5f40bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f2ffd700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5f4062480 0x7fe5f414b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f37fe700 1 -- 172.21.15.164:0/2896024171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5f4062860 msgr2=0x7fe5f40bebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f37fe700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5f4062860 0x7fe5f40bebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f37fe700 1 -- 172.21.15.164:0/2896024171 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5f4062480 msgr2=0x7fe5f414b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f37fe700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5f4062480 0x7fe5f414b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f37fe700 1 -- 172.21.15.164:0/2896024171 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f414c490 con 0x7fe5f40c2170 2020-11-20T12:02:32.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.913+0000 7fe5f37fe700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5f40c2170 0x7fe5f4163dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe5ec009260 tx=0x7fe5ec016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.914+0000 7fe5daffd700 1 -- 172.21.15.164:0/2896024171 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec01c6c0 con 0x7fe5f40c2170 2020-11-20T12:02:32.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.914+0000 7fe5daffd700 1 -- 172.21.15.164:0/2896024171 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec01c820 con 0x7fe5f40c2170 2020-11-20T12:02:32.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.914+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f414c730 con 0x7fe5f40c2170 2020-11-20T12:02:32.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.914+0000 7fe5daffd700 1 -- 172.21.15.164:0/2896024171 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec01cbc0 con 0x7fe5f40c2170 2020-11-20T12:02:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.914+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f40bf0c0 con 0x7fe5f40c2170 2020-11-20T12:02:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.915+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5f40608f0 con 0x7fe5f40c2170 2020-11-20T12:02:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.915+0000 7fe5daffd700 1 -- 172.21.15.164:0/2896024171 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe5ec017070 con 0x7fe5f40c2170 2020-11-20T12:02:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.916+0000 7fe5daffd700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe5d0080670 0x7fe5d0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.916+0000 7fe5daffd700 1 -- 172.21.15.164:0/2896024171 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fe5ec0a5180 con 0x7fe5f40c2170 2020-11-20T12:02:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.916+0000 7fe5f2ffd700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe5d0080670 0x7fe5d0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.916+0000 7fe5daffd700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] conn(0x7fe5d00893a0 0x7fe5d008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.916+0000 7fe5daffd700 1 -- 172.21.15.164:0/2896024171 --> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5d008be20 con 0x7fe5d00893a0 2020-11-20T12:02:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.916+0000 7fe5daffd700 1 -- 172.21.15.164:0/2896024171 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5ec0a7760 con 0x7fe5f40c2170 2020-11-20T12:02:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.916+0000 7fe5f2ffd700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe5d0080670 0x7fe5d0082b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe5e8001ed0 tx=0x7fe5e8001d30).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.916+0000 7fe5f27fc700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] conn(0x7fe5d00893a0 0x7fe5d008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.917+0000 7fe5f27fc700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] conn(0x7fe5d00893a0 0x7fe5d008b7c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.917+0000 7fe5daffd700 1 -- 172.21.15.164:0/2896024171 <== osd.7 v2:172.21.15.36:6808/23021 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fe5d008be20 con 0x7fe5d00893a0 2020-11-20T12:02:32.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.930+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 --> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe5f4069b70 con 0x7fe5d00893a0 2020-11-20T12:02:32.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5daffd700 1 -- 172.21.15.164:0/2896024171 <== osd.7 v2:172.21.15.36:6808/23021 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe5f4069b70 con 0x7fe5d00893a0 2020-11-20T12:02:32.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 >> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] conn(0x7fe5d00893a0 msgr2=0x7fe5d008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f94bb700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.36:6808/23021,v1:172.21.15.36:6809/23021] conn(0x7fe5d00893a0 0x7fe5d008b7c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:32.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe5d0080670 msgr2=0x7fe5d0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f94bb700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fe5d0080670 0x7fe5d0082b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe5e8001ed0 tx=0x7fe5e8001d30).stop 2020-11-20T12:02:32.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5f40c2170 msgr2=0x7fe5f4163dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:32.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f94bb700 1 --2- 172.21.15.164:0/2896024171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5f40c2170 0x7fe5f4163dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe5ec009260 tx=0x7fe5ec016000).stop 2020-11-20T12:02:32.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f37fe700 1 -- 172.21.15.164:0/2896024171 reap_dead start 2020-11-20T12:02:32.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 shutdown_connections 2020-11-20T12:02:32.937 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 >> 172.21.15.164:0/2896024171 conn(0x7fe5f4068370 msgr2=0x7fe5f414e370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:32.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 shutdown_connections 2020-11-20T12:02:32.938 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:32.931+0000 7fe5f94bb700 1 -- 172.21.15.164:0/2896024171 wait complete. 2020-11-20T12:02:32.938 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:32.939 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:32.939 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:32.947 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2020-11-20T12:02:33.059 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.055+0000 7fa266cf9700 1 Processor -- start 2020-11-20T12:02:33.059 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.055+0000 7fa266cf9700 1 -- start start 2020-11-20T12:02:33.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.055+0000 7fa266cf9700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa2600c4470 0x7fa2600c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.055+0000 7fa266cf9700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2601555a0 con 0x7fa2600bf680 2020-11-20T12:02:33.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.055+0000 7fa266cf9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2601517d0 con 0x7fa2600bccf0 2020-11-20T12:02:33.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.055+0000 7fa266cf9700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa260151a70 con 0x7fa2600c4470 2020-11-20T12:02:33.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25ffff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fa2600bccf0 0x7fa2600c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56116/0 (socket says 172.21.15.164:56116) 2020-11-20T12:02:33.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25ffff700 1 -- 172.21.15.164:0/145192037 learned_addr learned my addr 172.21.15.164:0/145192037 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:33.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa264a95700 1 --2- 172.21.15.164:0/145192037 >> v2:172.21.15.36:3300/0 conn(0x7fa2600c4470 0x7fa2600c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922037305 0 0) 0x7fa2601517d0 con 0x7fa2600bccf0 2020-11-20T12:02:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa244003280 con 0x7fa2600bccf0 2020-11-20T12:02:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1085626538 0 0) 0x7fa244003280 con 0x7fa2600bccf0 2020-11-20T12:02:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 >> v2:172.21.15.36:3300/0 conn(0x7fa2600c4470 msgr2=0x7fa2600c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 --2- 172.21.15.164:0/145192037 >> v2:172.21.15.36:3300/0 conn(0x7fa2600c4470 0x7fa2600c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 >> v1:172.21.15.36:6789/0 conn(0x7fa2600bf680 legacy=0x7fa2601504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260151d10 con 0x7fa2600bccf0 2020-11-20T12:02:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fa24c001520 con 0x7fa2600bccf0 2020-11-20T12:02:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 >> v1:172.21.15.164:6789/0 conn(0x7fa2600bccf0 legacy=0x7fa2600c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2440037c0 0x7fa244003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa244004520 0x7fa2440049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004e90 0x7fa24400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260151a70 con 0x7fa244004e90 2020-11-20T12:02:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa244005340 con 0x7fa244004520 2020-11-20T12:02:33.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24400bc60 con 0x7fa2440037c0 2020-11-20T12:02:33.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.056+0000 7fa25ffff700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa244004520 0x7fa2440049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa265296700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004e90 0x7fa24400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa264a95700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2440037c0 0x7fa244003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa25ffff700 1 -- 172.21.15.164:0/145192037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2440037c0 msgr2=0x7fa244003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:33.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa25ffff700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2440037c0 0x7fa244003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa25ffff700 1 -- 172.21.15.164:0/145192037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004e90 msgr2=0x7fa24400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:33.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa25ffff700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004e90 0x7fa24400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa25ffff700 1 -- 172.21.15.164:0/145192037 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244003280 con 0x7fa244004520 2020-11-20T12:02:33.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa264a95700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2440037c0 0x7fa244003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:33.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa265296700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004e90 0x7fa24400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:33.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa265296700 1 -- 172.21.15.164:0/145192037 reap_dead start 2020-11-20T12:02:33.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa25ffff700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa244004520 0x7fa2440049a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fa24c00c440 tx=0x7fa260151ea0).ready entity=mon.1 client_cookie=64042ca80c108f66 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00ce20 con 0x7fa244004520 2020-11-20T12:02:33.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c0072e0 con 0x7fa244004520 2020-11-20T12:02:33.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa25f7fe700 1 -- 172.21.15.164:0/145192037 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c005860 con 0x7fa244004520 2020-11-20T12:02:33.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa266cf9700 1 -- 172.21.15.164:0/145192037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa244004520 msgr2=0x7fa2440049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa266cf9700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa244004520 0x7fa2440049a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fa24c00c440 tx=0x7fa260151ea0).stop 2020-11-20T12:02:33.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa266cf9700 1 -- 172.21.15.164:0/145192037 shutdown_connections 2020-11-20T12:02:33.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa266cf9700 1 --2- 172.21.15.164:0/145192037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa244004520 0x7fa2440049a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa266cf9700 1 -- 172.21.15.164:0/145192037 >> 172.21.15.164:0/145192037 conn(0x7fa2600683b0 msgr2=0x7fa260061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:33.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa266cf9700 1 -- 172.21.15.164:0/145192037 shutdown_connections 2020-11-20T12:02:33.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.057+0000 7fa266cf9700 1 -- 172.21.15.164:0/145192037 wait complete. 2020-11-20T12:02:33.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.059+0000 7fa266cf9700 1 Processor -- start 2020-11-20T12:02:33.073 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.059+0000 7fa266cf9700 1 -- start start 2020-11-20T12:02:33.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.059+0000 7fa266cf9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004520 0x7fa26014c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.059+0000 7fa266cf9700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa26014cc10 0x7fa260112620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.059+0000 7fa266cf9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa260112b10 0x7fa260156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.059+0000 7fa266cf9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260153bb0 con 0x7fa244004520 2020-11-20T12:02:33.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.059+0000 7fa266cf9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260153e50 con 0x7fa260112b10 2020-11-20T12:02:33.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.059+0000 7fa266cf9700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601540f0 con 0x7fa26014cc10 2020-11-20T12:02:33.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa265296700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa260112b10 0x7fa260156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.077 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa265296700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa260112b10 0x7fa260156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46390/0 (socket says 172.21.15.164:46390) 2020-11-20T12:02:33.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa265296700 1 -- 172.21.15.164:0/4110215461 learned_addr learned my addr 172.21.15.164:0/4110215461 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:33.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa264a95700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004520 0x7fa26014c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa25ffff700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa26014cc10 0x7fa260112620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa265296700 1 -- 172.21.15.164:0/4110215461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa26014cc10 msgr2=0x7fa260112620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.078 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa265296700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa26014cc10 0x7fa260112620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa265296700 1 -- 172.21.15.164:0/4110215461 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004520 msgr2=0x7fa26014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa265296700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004520 0x7fa26014c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa265296700 1 -- 172.21.15.164:0/4110215461 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260154390 con 0x7fa260112b10 2020-11-20T12:02:33.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa264a95700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004520 0x7fa26014c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:33.079 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa265296700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa260112b10 0x7fa260156910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fa260081c20 tx=0x7fa258009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa25cff9700 1 -- 172.21.15.164:0/4110215461 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800c690 con 0x7fa260112b10 2020-11-20T12:02:33.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa25cff9700 1 -- 172.21.15.164:0/4110215461 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25800c7f0 con 0x7fa260112b10 2020-11-20T12:02:33.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa266cf9700 1 -- 172.21.15.164:0/4110215461 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa260154630 con 0x7fa260112b10 2020-11-20T12:02:33.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa25cff9700 1 -- 172.21.15.164:0/4110215461 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800cb70 con 0x7fa260112b10 2020-11-20T12:02:33.080 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.060+0000 7fa266cf9700 1 -- 172.21.15.164:0/4110215461 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa260156e00 con 0x7fa260112b10 2020-11-20T12:02:33.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.061+0000 7fa266cf9700 1 -- 172.21.15.164:0/4110215461 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2601547c0 con 0x7fa260112b10 2020-11-20T12:02:33.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.062+0000 7fa25cff9700 1 -- 172.21.15.164:0/4110215461 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa25801b030 con 0x7fa260112b10 2020-11-20T12:02:33.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.062+0000 7fa25cff9700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa238080670 0x7fa238082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.062+0000 7fa25cff9700 1 -- 172.21.15.164:0/4110215461 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa2580a2c40 con 0x7fa260112b10 2020-11-20T12:02:33.081 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.062+0000 7fa264a95700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa238080670 0x7fa238082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.063+0000 7fa264a95700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa238080670 0x7fa238082b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fa254006ad0 tx=0x7fa254008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.082 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.065+0000 7fa25cff9700 1 -- 172.21.15.164:0/4110215461 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa258077650 con 0x7fa260112b10 2020-11-20T12:02:33.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.208+0000 7fa266cf9700 1 -- 172.21.15.164:0/4110215461 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa260069b70 con 0x7fa238080670 2020-11-20T12:02:33.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.208+0000 7fa25cff9700 1 -- 172.21.15.164:0/4110215461 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa260069b70 con 0x7fa238080670 2020-11-20T12:02:33.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 -- 172.21.15.164:0/4110215461 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa238080670 msgr2=0x7fa238082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa238080670 0x7fa238082b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fa254006ad0 tx=0x7fa254008040).stop 2020-11-20T12:02:33.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 -- 172.21.15.164:0/4110215461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa260112b10 msgr2=0x7fa260156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa260112b10 0x7fa260156910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fa260081c20 tx=0x7fa258009040).stop 2020-11-20T12:02:33.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 -- 172.21.15.164:0/4110215461 shutdown_connections 2020-11-20T12:02:33.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa238080670 0x7fa238082b30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa260112b10 0x7fa260156910 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa244004520 0x7fa26014c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 --2- 172.21.15.164:0/4110215461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa26014cc10 0x7fa260112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 -- 172.21.15.164:0/4110215461 >> 172.21.15.164:0/4110215461 conn(0x7fa2600683b0 msgr2=0x7fa26014f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:33.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 -- 172.21.15.164:0/4110215461 shutdown_connections 2020-11-20T12:02:33.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.210+0000 7fa266cf9700 1 -- 172.21.15.164:0/4110215461 wait complete. 2020-11-20T12:02:33.217 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 7 to deep-scrub 2020-11-20T12:02:33.226 INFO:tasks.ceph:Scrubbing osd.10 2020-11-20T12:02:33.226 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:33.342 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.338+0000 7fa3b39ca700 1 Processor -- start 2020-11-20T12:02:33.342 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.338+0000 7fa3b39ca700 1 -- start start 2020-11-20T12:02:33.344 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b39ca700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa3ac061480 0x7fa3ac061860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.344 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b39ca700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa3ac0bc9e0 0x7fa3ac152c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.344 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b39ca700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac066470 con 0x7fa3ac0bce40 2020-11-20T12:02:33.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b39ca700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac061f90 con 0x7fa3ac0bc9e0 2020-11-20T12:02:33.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b39ca700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac066710 con 0x7fa3ac061480 2020-11-20T12:02:33.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b1766700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa3ac061480 0x7fa3ac061860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b1f67700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fa3ac0bce40 0x7fa3ac153110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56136/0 (socket says 172.21.15.164:56136) 2020-11-20T12:02:33.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b1f67700 1 -- 172.21.15.164:0/2497445084 learned_addr learned my addr 172.21.15.164:0/2497445084 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:33.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b0f65700 1 --2- 172.21.15.164:0/2497445084 >> v2:172.21.15.36:3300/0 conn(0x7fa3ac0bc9e0 0x7fa3ac152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b1766700 1 -- 172.21.15.164:0/2497445084 >> v2:172.21.15.36:3300/0 conn(0x7fa3ac0bc9e0 msgr2=0x7fa3ac152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:33.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b1766700 1 --2- 172.21.15.164:0/2497445084 >> v2:172.21.15.36:3300/0 conn(0x7fa3ac0bc9e0 0x7fa3ac152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b1766700 1 -- 172.21.15.164:0/2497445084 >> v1:172.21.15.164:6789/0 conn(0x7fa3ac0bce40 legacy=0x7fa3ac153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa39bfff700 1 -- 172.21.15.164:0/2497445084 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939728376 0 0) 0x7fa3ac066470 con 0x7fa3ac0bce40 2020-11-20T12:02:33.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b1766700 1 -- 172.21.15.164:0/2497445084 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0669b0 con 0x7fa3ac061480 2020-11-20T12:02:33.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b0f65700 1 --2- 172.21.15.164:0/2497445084 >> v2:172.21.15.36:3300/0 conn(0x7fa3ac0bc9e0 0x7fa3ac152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:33.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.339+0000 7fa3b1766700 1 --2- 172.21.15.164:0/2497445084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3ac061480 0x7fa3ac061860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fa3ac065b00 tx=0x7fa3a8006e30).ready entity=mon.1 client_cookie=3a9fc8c9b5f027d3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa39bfff700 1 -- 172.21.15.164:0/2497445084 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8009840 con 0x7fa3ac061480 2020-11-20T12:02:33.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa39bfff700 1 -- 172.21.15.164:0/2497445084 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8000e90 con 0x7fa3ac061480 2020-11-20T12:02:33.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa39bfff700 1 -- 172.21.15.164:0/2497445084 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8009bb0 con 0x7fa3ac061480 2020-11-20T12:02:33.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa3b39ca700 1 -- 172.21.15.164:0/2497445084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3ac061480 msgr2=0x7fa3ac061860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa3b39ca700 1 --2- 172.21.15.164:0/2497445084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3ac061480 0x7fa3ac061860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fa3ac065b00 tx=0x7fa3a8006e30).stop 2020-11-20T12:02:33.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa3b39ca700 1 -- 172.21.15.164:0/2497445084 shutdown_connections 2020-11-20T12:02:33.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa3b39ca700 1 --2- 172.21.15.164:0/2497445084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3ac061480 0x7fa3ac061860 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa3b39ca700 1 --2- 172.21.15.164:0/2497445084 >> v2:172.21.15.36:3300/0 conn(0x7fa3ac0bc9e0 0x7fa3ac152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa3b39ca700 1 -- 172.21.15.164:0/2497445084 >> 172.21.15.164:0/2497445084 conn(0x7fa3ac065690 msgr2=0x7fa3ac0601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:33.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa3b39ca700 1 -- 172.21.15.164:0/2497445084 shutdown_connections 2020-11-20T12:02:33.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.340+0000 7fa3b39ca700 1 -- 172.21.15.164:0/2497445084 wait complete. 2020-11-20T12:02:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.341+0000 7fa3b39ca700 1 Processor -- start 2020-11-20T12:02:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.341+0000 7fa3b39ca700 1 -- start start 2020-11-20T12:02:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b39ca700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3ac061480 0x7fa3ac0bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b39ca700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3ac0bc9e0 0x7fa3ac14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b39ca700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3ac0bce40 0x7fa3ac14ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b39ca700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0c2a50 con 0x7fa3ac0bc9e0 2020-11-20T12:02:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b39ca700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0baa20 con 0x7fa3ac0bce40 2020-11-20T12:02:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b39ca700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0bc380 con 0x7fa3ac061480 2020-11-20T12:02:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b1f67700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3ac0bce40 0x7fa3ac14ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b1f67700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3ac0bce40 0x7fa3ac14ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46406/0 (socket says 172.21.15.164:46406) 2020-11-20T12:02:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b1f67700 1 -- 172.21.15.164:0/200587549 learned_addr learned my addr 172.21.15.164:0/200587549 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b0f65700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3ac0bc9e0 0x7fa3ac14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.342+0000 7fa3b1766700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3ac061480 0x7fa3ac0bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3b1f67700 1 -- 172.21.15.164:0/200587549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3ac061480 msgr2=0x7fa3ac0bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3b1f67700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3ac061480 0x7fa3ac0bbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3b1f67700 1 -- 172.21.15.164:0/200587549 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3ac0bc9e0 msgr2=0x7fa3ac14ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3b1f67700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3ac0bc9e0 0x7fa3ac14ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3b1f67700 1 -- 172.21.15.164:0/200587549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0bfa10 con 0x7fa3ac0bce40 2020-11-20T12:02:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3b1f67700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3ac0bce40 0x7fa3ac14ef80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fa3a400cae0 tx=0x7fa3a4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3997fa700 1 -- 172.21.15.164:0/200587549 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4005bc0 con 0x7fa3ac0bce40 2020-11-20T12:02:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3997fa700 1 -- 172.21.15.164:0/200587549 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4005d20 con 0x7fa3ac0bce40 2020-11-20T12:02:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac0b9fa0 con 0x7fa3ac0bce40 2020-11-20T12:02:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3997fa700 1 -- 172.21.15.164:0/200587549 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4007320 con 0x7fa3ac0bce40 2020-11-20T12:02:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.343+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac0ba4e0 con 0x7fa3ac0bce40 2020-11-20T12:02:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.344+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3ac0634d0 con 0x7fa3ac0bce40 2020-11-20T12:02:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.344+0000 7fa3997fa700 1 -- 172.21.15.164:0/200587549 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa3a4010030 con 0x7fa3ac0bce40 2020-11-20T12:02:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.345+0000 7fa3997fa700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa384080670 0x7fa384082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.345+0000 7fa3997fa700 1 -- 172.21.15.164:0/200587549 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa3a40a3370 con 0x7fa3ac0bce40 2020-11-20T12:02:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.345+0000 7fa3b1766700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa384080670 0x7fa384082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.345+0000 7fa3997fa700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] conn(0x7fa384089320 0x7fa38408b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.345+0000 7fa3997fa700 1 -- 172.21.15.164:0/200587549 --> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa38408bda0 con 0x7fa384089320 2020-11-20T12:02:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.345+0000 7fa3997fa700 1 -- 172.21.15.164:0/200587549 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3a40a36e0 con 0x7fa3ac0bce40 2020-11-20T12:02:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.345+0000 7fa3b1766700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa384080670 0x7fa384082b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa3a8006e70 tx=0x7fa3a8015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.345+0000 7fa3b0f65700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] conn(0x7fa384089320 0x7fa38408b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.346+0000 7fa3b0f65700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] conn(0x7fa384089320 0x7fa38408b740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.347+0000 7fa3997fa700 1 -- 172.21.15.164:0/200587549 <== osd.10 v2:172.21.15.36:6815/23022 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fa38408bda0 con 0x7fa384089320 2020-11-20T12:02:33.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.359+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 --> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa3ac05d270 con 0x7fa384089320 2020-11-20T12:02:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3997fa700 1 -- 172.21.15.164:0/200587549 <== osd.10 v2:172.21.15.36:6815/23022 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa3ac05d270 con 0x7fa384089320 2020-11-20T12:02:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 >> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] conn(0x7fa384089320 msgr2=0x7fa38408b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b39ca700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.36:6815/23022,v1:172.21.15.36:6817/23022] conn(0x7fa384089320 0x7fa38408b740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa384080670 msgr2=0x7fa384082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b39ca700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa384080670 0x7fa384082b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa3a8006e70 tx=0x7fa3a8015000).stop 2020-11-20T12:02:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3ac0bce40 msgr2=0x7fa3ac14ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b39ca700 1 --2- 172.21.15.164:0/200587549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3ac0bce40 0x7fa3ac14ef80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fa3a400cae0 tx=0x7fa3a4007dc0).stop 2020-11-20T12:02:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b1f67700 1 -- 172.21.15.164:0/200587549 reap_dead start 2020-11-20T12:02:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 shutdown_connections 2020-11-20T12:02:33.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 >> 172.21.15.164:0/200587549 conn(0x7fa3ac065690 msgr2=0x7fa3ac1531b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:33.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 shutdown_connections 2020-11-20T12:02:33.367 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.360+0000 7fa3b39ca700 1 -- 172.21.15.164:0/200587549 wait complete. 2020-11-20T12:02:33.367 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:33.368 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:33.368 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:33.376 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2020-11-20T12:02:33.488 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.484+0000 7f028601a700 1 Processor -- start 2020-11-20T12:02:33.488 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.484+0000 7f028601a700 1 -- start start 2020-11-20T12:02:33.490 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f028601a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0280066850 0x7f0280066c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.491 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f028601a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f02800c03d0 0x7f0280154780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.491 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f028601a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0280155690 con 0x7f02800c5d70 2020-11-20T12:02:33.491 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f028601a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0280154c70 con 0x7f0280066850 2020-11-20T12:02:33.491 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f028601a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0280152180 con 0x7f02800c03d0 2020-11-20T12:02:33.491 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027effd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f02800c03d0 0x7f0280154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027ffff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f02800c5d70 0x7f0280151a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56154/0 (socket says 172.21.15.164:56154) 2020-11-20T12:02:33.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027ffff700 1 -- 172.21.15.164:0/1828764983 learned_addr learned my addr 172.21.15.164:0/1828764983 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:33.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027f7fe700 1 --2- 172.21.15.164:0/1828764983 >> v2:172.21.15.36:3300/0 conn(0x7f0280066850 0x7f0280066c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027effd700 1 -- 172.21.15.164:0/1828764983 >> v2:172.21.15.36:3300/0 conn(0x7f0280066850 msgr2=0x7f0280066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:33.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027effd700 1 --2- 172.21.15.164:0/1828764983 >> v2:172.21.15.36:3300/0 conn(0x7f0280066850 0x7f0280066c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027effd700 1 -- 172.21.15.164:0/1828764983 >> v1:172.21.15.164:6789/0 conn(0x7f02800c5d70 legacy=0x7f0280151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027e7fc700 1 -- 172.21.15.164:0/1828764983 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301988524 0 0) 0x7f0280155690 con 0x7f02800c5d70 2020-11-20T12:02:33.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027effd700 1 -- 172.21.15.164:0/1828764983 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280154eb0 con 0x7f02800c03d0 2020-11-20T12:02:33.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027f7fe700 1 --2- 172.21.15.164:0/1828764983 >> v2:172.21.15.36:3300/0 conn(0x7f0280066850 0x7f0280066c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:33.493 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027effd700 1 --2- 172.21.15.164:0/1828764983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 0x7f0280154780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0280067120 tx=0x7f0274006e30).ready entity=mon.1 client_cookie=223bb19d712554cb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027e7fc700 1 -- 172.21.15.164:0/1828764983 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274009840 con 0x7f02800c03d0 2020-11-20T12:02:33.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027e7fc700 1 -- 172.21.15.164:0/1828764983 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0274000e90 con 0x7f02800c03d0 2020-11-20T12:02:33.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.485+0000 7f027e7fc700 1 -- 172.21.15.164:0/1828764983 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274009bb0 con 0x7f02800c03d0 2020-11-20T12:02:33.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.486+0000 7f028601a700 1 -- 172.21.15.164:0/1828764983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 msgr2=0x7f0280154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.486+0000 7f028601a700 1 --2- 172.21.15.164:0/1828764983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 0x7f0280154780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0280067120 tx=0x7f0274006e30).stop 2020-11-20T12:02:33.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.486+0000 7f028601a700 1 -- 172.21.15.164:0/1828764983 shutdown_connections 2020-11-20T12:02:33.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.486+0000 7f028601a700 1 --2- 172.21.15.164:0/1828764983 >> v2:172.21.15.36:3300/0 conn(0x7f0280066850 0x7f0280066c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.486+0000 7f028601a700 1 --2- 172.21.15.164:0/1828764983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 0x7f0280154780 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.486+0000 7f028601a700 1 -- 172.21.15.164:0/1828764983 >> 172.21.15.164:0/1828764983 conn(0x7f0280060c80 msgr2=0x7f02800c5660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:33.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.486+0000 7f028601a700 1 -- 172.21.15.164:0/1828764983 shutdown_connections 2020-11-20T12:02:33.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.486+0000 7f028601a700 1 -- 172.21.15.164:0/1828764983 wait complete. 2020-11-20T12:02:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.487+0000 7f028601a700 1 Processor -- start 2020-11-20T12:02:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.487+0000 7f028601a700 1 -- start start 2020-11-20T12:02:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f028601a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0280066850 0x7f02800c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f028601a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 0x7f02800c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f028601a700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02800c5d70 0x7f02800c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f028601a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0280091070 con 0x7f0280066850 2020-11-20T12:02:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f028601a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0280090b30 con 0x7f02800c03d0 2020-11-20T12:02:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f028601a700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0280090dd0 con 0x7f02800c5d70 2020-11-20T12:02:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027effd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 0x7f02800c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027effd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 0x7f02800c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46418/0 (socket says 172.21.15.164:46418) 2020-11-20T12:02:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027effd700 1 -- 172.21.15.164:0/4100560350 learned_addr learned my addr 172.21.15.164:0/4100560350 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027f7fe700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0280066850 0x7f02800c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027ffff700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02800c5d70 0x7f02800c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027effd700 1 -- 172.21.15.164:0/4100560350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02800c5d70 msgr2=0x7f02800c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027effd700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02800c5d70 0x7f02800c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027effd700 1 -- 172.21.15.164:0/4100560350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0280066850 msgr2=0x7f02800c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027effd700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0280066850 0x7f02800c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027effd700 1 -- 172.21.15.164:0/4100560350 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02800c3fb0 con 0x7f02800c03d0 2020-11-20T12:02:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027ffff700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02800c5d70 0x7f02800c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f027effd700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 0x7f02800c4990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f02801522c0 tx=0x7f0274015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.488+0000 7f025f7fe700 1 -- 172.21.15.164:0/4100560350 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274011d30 con 0x7f02800c03d0 2020-11-20T12:02:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.489+0000 7f025f7fe700 1 -- 172.21.15.164:0/4100560350 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0274011e90 con 0x7f02800c03d0 2020-11-20T12:02:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.489+0000 7f028601a700 1 -- 172.21.15.164:0/4100560350 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02800c4250 con 0x7f02800c03d0 2020-11-20T12:02:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.489+0000 7f025f7fe700 1 -- 172.21.15.164:0/4100560350 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027401e690 con 0x7f02800c03d0 2020-11-20T12:02:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.489+0000 7f028601a700 1 -- 172.21.15.164:0/4100560350 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02800907b0 con 0x7f02800c03d0 2020-11-20T12:02:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.490+0000 7f028601a700 1 -- 172.21.15.164:0/4100560350 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0280080ba0 con 0x7f02800c03d0 2020-11-20T12:02:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.490+0000 7f025f7fe700 1 -- 172.21.15.164:0/4100560350 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0274025030 con 0x7f02800c03d0 2020-11-20T12:02:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.491+0000 7f025f7fe700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0258080670 0x7f0258082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.491+0000 7f025f7fe700 1 -- 172.21.15.164:0/4100560350 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f02740a4050 con 0x7f02800c03d0 2020-11-20T12:02:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.491+0000 7f027f7fe700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0258080670 0x7f0258082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.491+0000 7f027f7fe700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0258080670 0x7f0258082b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0270006c10 tx=0x7f0270008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.494+0000 7f025f7fe700 1 -- 172.21.15.164:0/4100560350 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0274078a60 con 0x7f02800c03d0 2020-11-20T12:02:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.636+0000 7f028601a700 1 -- 172.21.15.164:0/4100560350 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) v1 -- 0x7f0280069b70 con 0x7f0258080670 2020-11-20T12:02:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.636+0000 7f025f7fe700 1 -- 172.21.15.164:0/4100560350 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7f0280069b70 con 0x7f0258080670 2020-11-20T12:02:33.642 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 -- 172.21.15.164:0/4100560350 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0258080670 msgr2=0x7f0258082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0258080670 0x7f0258082b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0270006c10 tx=0x7f0270008040).stop 2020-11-20T12:02:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 -- 172.21.15.164:0/4100560350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 msgr2=0x7f02800c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 0x7f02800c4990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f02801522c0 tx=0x7f0274015000).stop 2020-11-20T12:02:33.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 -- 172.21.15.164:0/4100560350 shutdown_connections 2020-11-20T12:02:33.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f0258080670 0x7f0258082b30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02800c5d70 0x7f02800c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0280066850 0x7f02800c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 --2- 172.21.15.164:0/4100560350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02800c03d0 0x7f02800c4990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 -- 172.21.15.164:0/4100560350 >> 172.21.15.164:0/4100560350 conn(0x7f0280060c80 msgr2=0x7f0280150110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:33.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 -- 172.21.15.164:0/4100560350 shutdown_connections 2020-11-20T12:02:33.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.638+0000 7f028601a700 1 -- 172.21.15.164:0/4100560350 wait complete. 2020-11-20T12:02:33.646 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 10 to deep-scrub 2020-11-20T12:02:33.654 INFO:tasks.ceph:Scrubbing osd.2 2020-11-20T12:02:33.654 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.765+0000 7fd7568b5700 1 Processor -- start 2020-11-20T12:02:33.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.765+0000 7fd7568b5700 1 -- start start 2020-11-20T12:02:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.766+0000 7fd7568b5700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd7500669e0 0x7fd7500bf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.766+0000 7fd7568b5700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd750064d60 con 0x7fd750061b80 2020-11-20T12:02:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.766+0000 7fd7568b5700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd750064580 con 0x7fd750066600 2020-11-20T12:02:33.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.766+0000 7fd7568b5700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd750064820 con 0x7fd7500669e0 2020-11-20T12:02:33.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.766+0000 7fd754e52700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fd750061b80 0x7fd750062010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56166/0 (socket says 172.21.15.164:56166) 2020-11-20T12:02:33.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.766+0000 7fd754e52700 1 -- 172.21.15.164:0/2653375576 learned_addr learned my addr 172.21.15.164:0/2653375576 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:33.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.766+0000 7fd74f7fe700 1 --2- 172.21.15.164:0/2653375576 >> v2:172.21.15.188:3300/0 conn(0x7fd7500669e0 0x7fd7500bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.766+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954501639 0 0) 0x7fd748001490 con 0x7fd750061b80 2020-11-20T12:02:33.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.766+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd73c003280 con 0x7fd750061b80 2020-11-20T12:02:33.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3381501722 0 0) 0x7fd73c003280 con 0x7fd750061b80 2020-11-20T12:02:33.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 >> v2:172.21.15.188:3300/0 conn(0x7fd7500669e0 msgr2=0x7fd7500bf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:33.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 --2- 172.21.15.164:0/2653375576 >> v2:172.21.15.188:3300/0 conn(0x7fd7500669e0 0x7fd7500bf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 >> v1:172.21.15.188:6789/0 conn(0x7fd750066600 legacy=0x7fd750063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750064ac0 con 0x7fd750061b80 2020-11-20T12:02:33.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fd748001a30 con 0x7fd750061b80 2020-11-20T12:02:33.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 >> v1:172.21.15.164:6789/0 conn(0x7fd750061b80 legacy=0x7fd750062010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 --2- 172.21.15.164:0/2653375576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd73c0037c0 0x7fd73c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 --2- 172.21.15.164:0/2653375576 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd73c004520 0x7fd73c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 --2- 172.21.15.164:0/2653375576 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd73c004e90 0x7fd73c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd750064820 con 0x7fd73c004e90 2020-11-20T12:02:33.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c005340 con 0x7fd73c0037c0 2020-11-20T12:02:33.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c00bc60 con 0x7fd73c004520 2020-11-20T12:02:33.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74ffff700 1 --2- 172.21.15.164:0/2653375576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd73c0037c0 0x7fd73c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74f7fe700 1 --2- 172.21.15.164:0/2653375576 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd73c004520 0x7fd73c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74ffff700 1 -- 172.21.15.164:0/2653375576 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd73c004520 msgr2=0x7fd73c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:33.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74ffff700 1 --2- 172.21.15.164:0/2653375576 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd73c004520 0x7fd73c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74ffff700 1 -- 172.21.15.164:0/2653375576 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd73c004e90 msgr2=0x7fd73c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:33.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74ffff700 1 --2- 172.21.15.164:0/2653375576 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd73c004e90 0x7fd73c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:02:33.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd754e52700 1 -- 172.21.15.164:0/2653375576 reap_dead start 2020-11-20T12:02:33.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74ffff700 1 -- 172.21.15.164:0/2653375576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c003280 con 0x7fd73c0037c0 2020-11-20T12:02:33.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74ffff700 1 --2- 172.21.15.164:0/2653375576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd73c0037c0 0x7fd73c003be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd740001960 tx=0x7fd740007bd0).ready entity=mon.1 client_cookie=bcc6d60250fff30d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740007020 con 0x7fd73c0037c0 2020-11-20T12:02:33.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd740007180 con 0x7fd73c0037c0 2020-11-20T12:02:33.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.767+0000 7fd74effd700 1 -- 172.21.15.164:0/2653375576 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74000c860 con 0x7fd73c0037c0 2020-11-20T12:02:33.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.768+0000 7fd7568b5700 1 -- 172.21.15.164:0/2653375576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd73c0037c0 msgr2=0x7fd73c003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.768+0000 7fd7568b5700 1 --2- 172.21.15.164:0/2653375576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd73c0037c0 0x7fd73c003be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd740001960 tx=0x7fd740007bd0).stop 2020-11-20T12:02:33.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.768+0000 7fd7568b5700 1 -- 172.21.15.164:0/2653375576 shutdown_connections 2020-11-20T12:02:33.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.768+0000 7fd7568b5700 1 --2- 172.21.15.164:0/2653375576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd73c0037c0 0x7fd73c003be0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.768+0000 7fd7568b5700 1 -- 172.21.15.164:0/2653375576 >> 172.21.15.164:0/2653375576 conn(0x7fd7500c55e0 msgr2=0x7fd7500c59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:33.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.768+0000 7fd7568b5700 1 -- 172.21.15.164:0/2653375576 shutdown_connections 2020-11-20T12:02:33.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.768+0000 7fd7568b5700 1 -- 172.21.15.164:0/2653375576 wait complete. 2020-11-20T12:02:33.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.769+0000 7fd7568b5700 1 Processor -- start 2020-11-20T12:02:33.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.769+0000 7fd7568b5700 1 -- start start 2020-11-20T12:02:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd7568b5700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd73c0037c0 0x7fd75009c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd7568b5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd75009add0 0x7fd75009d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd7568b5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7500c4660 0x7fd7500c0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd7568b5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75009c9a0 con 0x7fd7500c4660 2020-11-20T12:02:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd7568b5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75009cc40 con 0x7fd75009add0 2020-11-20T12:02:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd7568b5700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7500c11c0 con 0x7fd73c0037c0 2020-11-20T12:02:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74f7fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd75009add0 0x7fd75009d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74f7fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd75009add0 0x7fd75009d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46438/0 (socket says 172.21.15.164:46438) 2020-11-20T12:02:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74f7fe700 1 -- 172.21.15.164:0/1018508419 learned_addr learned my addr 172.21.15.164:0/1018508419 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74ffff700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd73c0037c0 0x7fd75009c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd754e52700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7500c4660 0x7fd7500c0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74f7fe700 1 -- 172.21.15.164:0/1018508419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd73c0037c0 msgr2=0x7fd75009c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74f7fe700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd73c0037c0 0x7fd75009c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74f7fe700 1 -- 172.21.15.164:0/1018508419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7500c4660 msgr2=0x7fd7500c0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74f7fe700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7500c4660 0x7fd7500c0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74f7fe700 1 -- 172.21.15.164:0/1018508419 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7500c1460 con 0x7fd75009add0 2020-11-20T12:02:33.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74ffff700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd73c0037c0 0x7fd75009c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:33.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd754e52700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7500c4660 0x7fd7500c0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:33.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd74f7fe700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd75009add0 0x7fd75009d160 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fd744011cc0 tx=0x7fd744006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.770+0000 7fd72ffff700 1 -- 172.21.15.164:0/1018508419 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744011e70 con 0x7fd75009add0 2020-11-20T12:02:33.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.771+0000 7fd72ffff700 1 -- 172.21.15.164:0/1018508419 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd744000e90 con 0x7fd75009add0 2020-11-20T12:02:33.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.771+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7500c1700 con 0x7fd75009add0 2020-11-20T12:02:33.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.771+0000 7fd72ffff700 1 -- 172.21.15.164:0/1018508419 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74400fee0 con 0x7fd75009add0 2020-11-20T12:02:33.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.771+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7500c5200 con 0x7fd75009add0 2020-11-20T12:02:33.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.771+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd750069b70 con 0x7fd75009add0 2020-11-20T12:02:33.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.772+0000 7fd72ffff700 1 -- 172.21.15.164:0/1018508419 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd744014650 con 0x7fd75009add0 2020-11-20T12:02:33.790 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.772+0000 7fd72ffff700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7280806a0 0x7fd728082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.773+0000 7fd72ffff700 1 -- 172.21.15.164:0/1018508419 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd7440a39f0 con 0x7fd75009add0 2020-11-20T12:02:33.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.773+0000 7fd74ffff700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7280806a0 0x7fd728082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.773+0000 7fd72ffff700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] conn(0x7fd7280893d0 0x7fd72808b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.773+0000 7fd72ffff700 1 -- 172.21.15.164:0/1018508419 --> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd72808be50 con 0x7fd7280893d0 2020-11-20T12:02:33.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.773+0000 7fd72ffff700 1 -- 172.21.15.164:0/1018508419 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7440a3d60 con 0x7fd75009add0 2020-11-20T12:02:33.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.773+0000 7fd74ffff700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7280806a0 0x7fd728082b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fd740000fd0 tx=0x7fd740015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.773+0000 7fd754e52700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] conn(0x7fd7280893d0 0x7fd72808b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.773+0000 7fd754e52700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] conn(0x7fd7280893d0 0x7fd72808b7f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.774+0000 7fd72ffff700 1 -- 172.21.15.164:0/1018508419 <== osd.2 v2:172.21.15.188:6800/23468 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fd72808be50 con 0x7fd7280893d0 2020-11-20T12:02:33.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.787+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 --> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd7500c4d00 con 0x7fd7280893d0 2020-11-20T12:02:33.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd72ffff700 1 -- 172.21.15.164:0/1018508419 <== osd.2 v2:172.21.15.188:6800/23468 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd7500c4d00 con 0x7fd7280893d0 2020-11-20T12:02:33.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 >> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] conn(0x7fd7280893d0 msgr2=0x7fd72808b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd7568b5700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.188:6800/23468,v1:172.21.15.188:6801/23468] conn(0x7fd7280893d0 0x7fd72808b7f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7280806a0 msgr2=0x7fd728082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd7568b5700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fd7280806a0 0x7fd728082b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fd740000fd0 tx=0x7fd740015000).stop 2020-11-20T12:02:33.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd75009add0 msgr2=0x7fd75009d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd7568b5700 1 --2- 172.21.15.164:0/1018508419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd75009add0 0x7fd75009d160 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fd744011cc0 tx=0x7fd744006e30).stop 2020-11-20T12:02:33.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd754e52700 1 -- 172.21.15.164:0/1018508419 reap_dead start 2020-11-20T12:02:33.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 shutdown_connections 2020-11-20T12:02:33.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 >> 172.21.15.164:0/1018508419 conn(0x7fd7500c55e0 msgr2=0x7fd7500c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:33.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 shutdown_connections 2020-11-20T12:02:33.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.788+0000 7fd7568b5700 1 -- 172.21.15.164:0/1018508419 wait complete. 2020-11-20T12:02:33.797 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:33.797 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:33.797 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:33.804 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2020-11-20T12:02:33.913 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.909+0000 7fcdc3945700 1 Processor -- start 2020-11-20T12:02:33.914 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.910+0000 7fcdc3945700 1 -- start start 2020-11-20T12:02:33.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.910+0000 7fcdc3945700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcdbc0c4200 0x7fcdbc0bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.910+0000 7fcdc3945700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcdbc0c0ba0 0x7fcdbc0bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.910+0000 7fcdc3945700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdbc151780 con 0x7fcdbc0c45e0 2020-11-20T12:02:33.916 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.910+0000 7fcdc3945700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdbc0c4a60 con 0x7fcdbc0c4200 2020-11-20T12:02:33.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.910+0000 7fcdc3945700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdbc151a20 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdc1ee2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcdbc0c0ba0 0x7fcdbc0bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdc1ee2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcdbc0c0ba0 0x7fcdbc0bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46450/0 (socket says 172.21.15.164:46450) 2020-11-20T12:02:33.917 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdc1ee2700 1 -- 172.21.15.164:0/754641415 learned_addr learned my addr 172.21.15.164:0/754641415 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:33.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdc16e1700 1 --2- 172.21.15.164:0/754641415 >> v2:172.21.15.36:3300/0 conn(0x7fcdbc0c4200 0x7fcdbc0bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdc1ee2700 1 -- 172.21.15.164:0/754641415 >> v2:172.21.15.36:3300/0 conn(0x7fcdbc0c4200 msgr2=0x7fcdbc0bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:33.918 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdc1ee2700 1 --2- 172.21.15.164:0/754641415 >> v2:172.21.15.36:3300/0 conn(0x7fcdbc0c4200 0x7fcdbc0bccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdc1ee2700 1 -- 172.21.15.164:0/754641415 >> v1:172.21.15.188:6789/0 conn(0x7fcdbc0c45e0 legacy=0x7fcdbc150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdc1ee2700 1 -- 172.21.15.164:0/754641415 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc151cc0 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdc1ee2700 1 --2- 172.21.15.164:0/754641415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 0x7fcdbc0bf550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fcdbc061610 tx=0x7fcdb40092d0).ready entity=mon.1 client_cookie=1a77b3ede7ad2999 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdabfff700 1 -- 172.21.15.164:0/754641415 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400bbf0 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdabfff700 1 -- 172.21.15.164:0/754641415 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400bd50 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.911+0000 7fcdabfff700 1 -- 172.21.15.164:0/754641415 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4011610 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.912+0000 7fcdc3945700 1 -- 172.21.15.164:0/754641415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 msgr2=0x7fcdbc0bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.912+0000 7fcdc3945700 1 --2- 172.21.15.164:0/754641415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 0x7fcdbc0bf550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fcdbc061610 tx=0x7fcdb40092d0).stop 2020-11-20T12:02:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.912+0000 7fcdc3945700 1 -- 172.21.15.164:0/754641415 shutdown_connections 2020-11-20T12:02:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.912+0000 7fcdc3945700 1 --2- 172.21.15.164:0/754641415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 0x7fcdbc0bf550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.912+0000 7fcdc3945700 1 --2- 172.21.15.164:0/754641415 >> v2:172.21.15.36:3300/0 conn(0x7fcdbc0c4200 0x7fcdbc0bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.912+0000 7fcdc3945700 1 -- 172.21.15.164:0/754641415 >> 172.21.15.164:0/754641415 conn(0x7fcdbc0678e0 msgr2=0x7fcdbc067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.912+0000 7fcdc3945700 1 -- 172.21.15.164:0/754641415 shutdown_connections 2020-11-20T12:02:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.912+0000 7fcdc3945700 1 -- 172.21.15.164:0/754641415 wait complete. 2020-11-20T12:02:33.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.913+0000 7fcdc3945700 1 Processor -- start 2020-11-20T12:02:33.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.913+0000 7fcdc3945700 1 -- start start 2020-11-20T12:02:33.925 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc3945700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 0x7fcdbc160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc3945700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcdbc0c4200 0x7fcdbc0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc3945700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdbc0c45e0 0x7fcdbc1545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc3945700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0c66c0 con 0x7fcdbc0c4200 2020-11-20T12:02:33.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc3945700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0c6180 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.926 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc3945700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0c6420 con 0x7fcdbc0c45e0 2020-11-20T12:02:33.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc16e1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 0x7fcdbc160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc16e1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 0x7fcdbc160d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46452/0 (socket says 172.21.15.164:46452) 2020-11-20T12:02:33.927 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc16e1700 1 -- 172.21.15.164:0/2124202463 learned_addr learned my addr 172.21.15.164:0/2124202463 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:33.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc1ee2700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdbc0c45e0 0x7fcdbc1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc0ee0700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcdbc0c4200 0x7fcdbc0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc16e1700 1 -- 172.21.15.164:0/2124202463 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdbc0c45e0 msgr2=0x7fcdbc1545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.928 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc16e1700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdbc0c45e0 0x7fcdbc1545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc16e1700 1 -- 172.21.15.164:0/2124202463 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcdbc0c4200 msgr2=0x7fcdbc0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:33.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc16e1700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcdbc0c4200 0x7fcdbc0c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:33.929 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc16e1700 1 -- 172.21.15.164:0/2124202463 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc0c6ca0 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc16e1700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 0x7fcdbc160d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fcdb800c930 tx=0x7fcdb8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcda97fa700 1 -- 172.21.15.164:0/2124202463 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb80075f0 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcda97fa700 1 -- 172.21.15.164:0/2124202463 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb8007750 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.931 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc3945700 1 -- 172.21.15.164:0/2124202463 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdbc0c6f40 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.931 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcda97fa700 1 -- 172.21.15.164:0/2124202463 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8007af0 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.931 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.914+0000 7fcdc3945700 1 -- 172.21.15.164:0/2124202463 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdbc0c8400 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.932 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.915+0000 7fcdc3945700 1 -- 172.21.15.164:0/2124202463 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdbc069b70 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.932 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.916+0000 7fcda97fa700 1 -- 172.21.15.164:0/2124202463 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fcdb8011410 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.932 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.916+0000 7fcda97fa700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcd94080670 0x7fcd94082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:33.932 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.916+0000 7fcda97fa700 1 -- 172.21.15.164:0/2124202463 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fcdb80a37e0 con 0x7fcdbc0c0ba0 2020-11-20T12:02:33.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.916+0000 7fcdc0ee0700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcd94080670 0x7fcd94082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:33.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.917+0000 7fcdc0ee0700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcd94080670 0x7fcd94082b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fcdbc163830 tx=0x7fcdac009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:33.933 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:33.919+0000 7fcda97fa700 1 -- 172.21.15.164:0/2124202463 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fcdb8078190 con 0x7fcdbc0c0ba0 2020-11-20T12:02:34.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.061+0000 7fcdc3945700 1 -- 172.21.15.164:0/2124202463 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdbc05d590 con 0x7fcd94080670 2020-11-20T12:02:34.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.062+0000 7fcda97fa700 1 -- 172.21.15.164:0/2124202463 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcdbc05d590 con 0x7fcd94080670 2020-11-20T12:02:34.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 -- 172.21.15.164:0/2124202463 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcd94080670 msgr2=0x7fcd94082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcd94080670 0x7fcd94082b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fcdbc163830 tx=0x7fcdac009040).stop 2020-11-20T12:02:34.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 -- 172.21.15.164:0/2124202463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 msgr2=0x7fcdbc160d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 0x7fcdbc160d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fcdb800c930 tx=0x7fcdb8008040).stop 2020-11-20T12:02:34.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 -- 172.21.15.164:0/2124202463 shutdown_connections 2020-11-20T12:02:34.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fcd94080670 0x7fcd94082b30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdbc0c0ba0 0x7fcdbc160d40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdbc0c45e0 0x7fcdbc1545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 --2- 172.21.15.164:0/2124202463 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcdbc0c4200 0x7fcdbc0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 -- 172.21.15.164:0/2124202463 >> 172.21.15.164:0/2124202463 conn(0x7fcdbc0678e0 msgr2=0x7fcdbc0bdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:34.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 -- 172.21.15.164:0/2124202463 shutdown_connections 2020-11-20T12:02:34.073 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.063+0000 7fcdc3945700 1 -- 172.21.15.164:0/2124202463 wait complete. 2020-11-20T12:02:34.073 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 2 to deep-scrub 2020-11-20T12:02:34.079 INFO:tasks.ceph:Scrubbing osd.5 2020-11-20T12:02:34.080 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:34.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.189+0000 7f2784225700 1 Processor -- start 2020-11-20T12:02:34.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.189+0000 7f2784225700 1 -- start start 2020-11-20T12:02:34.196 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2784225700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f277c14e870 0x7f277c0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.196 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2784225700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c09d300 con 0x7f277c0c4360 2020-11-20T12:02:34.197 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2784225700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c151f70 con 0x7f277c155330 2020-11-20T12:02:34.197 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2784225700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c09e8c0 con 0x7f277c14e870 2020-11-20T12:02:34.197 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f27817c0700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f277c155330 0x7f277c14e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56200/0 (socket says 172.21.15.164:56200) 2020-11-20T12:02:34.197 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f27817c0700 1 -- 172.21.15.164:0/2524278875 learned_addr learned my addr 172.21.15.164:0/2524278875 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:34.198 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f27827c2700 1 --2- 172.21.15.164:0/2524278875 >> v2:172.21.15.36:3300/0 conn(0x7f277c14e870 0x7f277c0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.198 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136172211 0 0) 0x7f277c151f70 con 0x7f277c155330 2020-11-20T12:02:34.198 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2764003280 con 0x7f277c155330 2020-11-20T12:02:34.198 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2428068388 0 0) 0x7f2764003280 con 0x7f277c155330 2020-11-20T12:02:34.198 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 >> v2:172.21.15.36:3300/0 conn(0x7f277c14e870 msgr2=0x7f277c0c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:34.198 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 --2- 172.21.15.164:0/2524278875 >> v2:172.21.15.36:3300/0 conn(0x7f277c14e870 0x7f277c0c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.199 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 >> v1:172.21.15.36:6789/0 conn(0x7f277c0c4360 legacy=0x7f277c09e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.199 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c09d530 con 0x7f277c155330 2020-11-20T12:02:34.199 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7f2778001520 con 0x7f277c155330 2020-11-20T12:02:34.199 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 >> v1:172.21.15.164:6789/0 conn(0x7f277c155330 legacy=0x7f277c14e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.200 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27640037c0 0x7f2764003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.200 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2764004520 0x7f27640049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.200 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2764004e90 0x7f276400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.200 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c09e8c0 con 0x7f2764004e90 2020-11-20T12:02:34.200 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2764005340 con 0x7f2764004520 2020-11-20T12:02:34.200 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.190+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276400bc60 con 0x7f27640037c0 2020-11-20T12:02:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f27817c0700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2764004520 0x7f27640049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f27827c2700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2764004e90 0x7f276400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f2781fc1700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27640037c0 0x7f2764003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f27817c0700 1 -- 172.21.15.164:0/2524278875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27640037c0 msgr2=0x7f2764003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f27817c0700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27640037c0 0x7f2764003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.202 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f27817c0700 1 -- 172.21.15.164:0/2524278875 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2764004e90 msgr2=0x7f276400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:34.202 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f27817c0700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2764004e90 0x7f276400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.202 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f27817c0700 1 -- 172.21.15.164:0/2524278875 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764003280 con 0x7f2764004520 2020-11-20T12:02:34.202 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f27827c2700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2764004e90 0x7f276400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:34.202 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f27827c2700 1 -- 172.21.15.164:0/2524278875 reap_dead start 2020-11-20T12:02:34.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f27817c0700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2764004520 0x7f27640049a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f277800c410 tx=0x7f277c081bc0).ready entity=mon.1 client_cookie=fa0295c51766ec87 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27780070d0 con 0x7f2764004520 2020-11-20T12:02:34.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2778007230 con 0x7f2764004520 2020-11-20T12:02:34.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f2780fbf700 1 -- 172.21.15.164:0/2524278875 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778005630 con 0x7f2764004520 2020-11-20T12:02:34.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.191+0000 7f2784225700 1 -- 172.21.15.164:0/2524278875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2764004520 msgr2=0x7f27640049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.204 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.192+0000 7f2784225700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2764004520 0x7f27640049a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f277800c410 tx=0x7f277c081bc0).stop 2020-11-20T12:02:34.204 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.192+0000 7f2784225700 1 -- 172.21.15.164:0/2524278875 shutdown_connections 2020-11-20T12:02:34.204 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.192+0000 7f2784225700 1 --2- 172.21.15.164:0/2524278875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2764004520 0x7f27640049a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.204 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.192+0000 7f2784225700 1 -- 172.21.15.164:0/2524278875 >> 172.21.15.164:0/2524278875 conn(0x7f277c068370 msgr2=0x7f277c07ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:34.204 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.192+0000 7f2784225700 1 -- 172.21.15.164:0/2524278875 shutdown_connections 2020-11-20T12:02:34.205 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.192+0000 7f2784225700 1 -- 172.21.15.164:0/2524278875 wait complete. 2020-11-20T12:02:34.207 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.193+0000 7f2784225700 1 Processor -- start 2020-11-20T12:02:34.207 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.193+0000 7f2784225700 1 -- start start 2020-11-20T12:02:34.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f2784225700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2764004520 0x7f277c14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f2784225700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f277c161900 0x7f277c0c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f2784225700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f277c0c6590 0x7f277c160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f2784225700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c151cb0 con 0x7f2764004520 2020-11-20T12:02:34.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f2784225700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c14f400 con 0x7f277c0c6590 2020-11-20T12:02:34.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f2784225700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c14f6a0 con 0x7f277c161900 2020-11-20T12:02:34.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f27817c0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f277c161900 0x7f277c0c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f2781fc1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2764004520 0x7f277c14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f27817c0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f277c161900 0x7f277c0c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.164:39738/0 (socket says 172.21.15.164:39738) 2020-11-20T12:02:34.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f27817c0700 1 -- 172.21.15.164:0/4238561720 learned_addr learned my addr 172.21.15.164:0/4238561720 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:34.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f27817c0700 1 -- 172.21.15.164:0/4238561720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f277c0c6590 msgr2=0x7f277c160c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-11-20T12:02:34.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f27817c0700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f277c0c6590 0x7f277c160c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:02:34.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f27817c0700 1 -- 172.21.15.164:0/4238561720 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2764004520 msgr2=0x7f277c14ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f27817c0700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2764004520 0x7f277c14ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f27817c0700 1 -- 172.21.15.164:0/4238561720 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c14f940 con 0x7f277c161900 2020-11-20T12:02:34.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.194+0000 7f27817c0700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f277c161900 0x7f277c0c60a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f27640054d0 tx=0x7f2778015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.195+0000 7f2769ffb700 1 -- 172.21.15.164:0/4238561720 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27780073a0 con 0x7f277c161900 2020-11-20T12:02:34.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.195+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c14fbe0 con 0x7f277c161900 2020-11-20T12:02:34.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.195+0000 7f2769ffb700 1 -- 172.21.15.164:0/4238561720 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2778007500 con 0x7f277c161900 2020-11-20T12:02:34.211 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.195+0000 7f2769ffb700 1 -- 172.21.15.164:0/4238561720 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27780206b0 con 0x7f277c161900 2020-11-20T12:02:34.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.195+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c1607e0 con 0x7f277c161900 2020-11-20T12:02:34.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.196+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f277c069b70 con 0x7f277c161900 2020-11-20T12:02:34.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.197+0000 7f2769ffb700 1 -- 172.21.15.164:0/4238561720 <== mon.2 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2778010070 con 0x7f277c161900 2020-11-20T12:02:34.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.197+0000 7f2769ffb700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f27540806a0 0x7f2754082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.197+0000 7f2769ffb700 1 -- 172.21.15.164:0/4238561720 <== mon.2 v2:172.21.15.188:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f27780a3f10 con 0x7f277c161900 2020-11-20T12:02:34.212 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.197+0000 7f2781fc1700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f27540806a0 0x7f2754082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.197+0000 7f2769ffb700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] conn(0x7f2754089350 0x7f275408b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.197+0000 7f2769ffb700 1 -- 172.21.15.164:0/4238561720 --> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f275408bdd0 con 0x7f2754089350 2020-11-20T12:02:34.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.197+0000 7f2769ffb700 1 -- 172.21.15.164:0/4238561720 <== mon.2 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27780a4220 con 0x7f277c161900 2020-11-20T12:02:34.213 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.198+0000 7f2781fc1700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f27540806a0 0x7f2754082b60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f276c000c00 tx=0x7f276c009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.198+0000 7f27827c2700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] conn(0x7f2754089350 0x7f275408b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.198+0000 7f27827c2700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] conn(0x7f2754089350 0x7f275408b770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.214 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.199+0000 7f2769ffb700 1 -- 172.21.15.164:0/4238561720 <== osd.5 v2:172.21.15.188:6808/23469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f275408bdd0 con 0x7f2754089350 2020-11-20T12:02:34.216 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.212+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 --> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f277c1613b0 con 0x7f2754089350 2020-11-20T12:02:34.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.212+0000 7f2769ffb700 1 -- 172.21.15.164:0/4238561720 <== osd.5 v2:172.21.15.188:6808/23469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f277c1613b0 con 0x7f2754089350 2020-11-20T12:02:34.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 >> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] conn(0x7f2754089350 msgr2=0x7f275408b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f2784225700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.188:6808/23469,v1:172.21.15.188:6809/23469] conn(0x7f2754089350 0x7f275408b770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f27540806a0 msgr2=0x7f2754082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f2784225700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f27540806a0 0x7f2754082b60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f276c000c00 tx=0x7f276c009040).stop 2020-11-20T12:02:34.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f277c161900 msgr2=0x7f277c0c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f2784225700 1 --2- 172.21.15.164:0/4238561720 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f277c161900 0x7f277c0c60a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f27640054d0 tx=0x7f2778015000).stop 2020-11-20T12:02:34.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f27827c2700 1 -- 172.21.15.164:0/4238561720 reap_dead start 2020-11-20T12:02:34.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 shutdown_connections 2020-11-20T12:02:34.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 >> 172.21.15.164:0/4238561720 conn(0x7f277c068370 msgr2=0x7f277c14a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:34.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 shutdown_connections 2020-11-20T12:02:34.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.213+0000 7f2784225700 1 -- 172.21.15.164:0/4238561720 wait complete. 2020-11-20T12:02:34.220 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:34.220 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:34.220 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:34.229 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2020-11-20T12:02:34.341 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.337+0000 7fa5d6305700 1 Processor -- start 2020-11-20T12:02:34.341 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.337+0000 7fa5d6305700 1 -- start start 2020-11-20T12:02:34.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.338+0000 7fa5d6305700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa5d014e140 0x7fa5d0067b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.338+0000 7fa5d6305700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00bc600 con 0x7fa5d0063e80 2020-11-20T12:02:34.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.338+0000 7fa5d6305700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00bc8a0 con 0x7fa5d00677a0 2020-11-20T12:02:34.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.338+0000 7fa5d6305700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00bcb40 con 0x7fa5d014e140 2020-11-20T12:02:34.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.338+0000 7fa5cf7fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fa5d0063e80 0x7fa5d00bb780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56220/0 (socket says 172.21.15.164:56220) 2020-11-20T12:02:34.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.338+0000 7fa5cf7fe700 1 -- 172.21.15.164:0/2896078585 learned_addr learned my addr 172.21.15.164:0/2896078585 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:34.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.338+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916703337 0 0) 0x7fa5d00bc600 con 0x7fa5d0063e80 2020-11-20T12:02:34.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.338+0000 7fa5d48a2700 1 --2- 172.21.15.164:0/2896078585 >> v2:172.21.15.36:3300/0 conn(0x7fa5d014e140 0x7fa5d0067b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.338+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5bc003280 con 0x7fa5d0063e80 2020-11-20T12:02:34.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 <== mon.2 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686321617 0 0) 0x7fa5d00bc8a0 con 0x7fa5d00677a0 2020-11-20T12:02:34.347 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d00bc600 con 0x7fa5d00677a0 2020-11-20T12:02:34.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4195869484 0 0) 0x7fa5bc003280 con 0x7fa5d0063e80 2020-11-20T12:02:34.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 >> v2:172.21.15.36:3300/0 conn(0x7fa5d014e140 msgr2=0x7fa5d0067b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:34.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 --2- 172.21.15.164:0/2896078585 >> v2:172.21.15.36:3300/0 conn(0x7fa5d014e140 0x7fa5d0067b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 >> v1:172.21.15.188:6789/0 conn(0x7fa5d00677a0 legacy=0x7fa5d0063770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.348 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d00bcde0 con 0x7fa5d0063e80 2020-11-20T12:02:34.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fa5c4001520 con 0x7fa5d0063e80 2020-11-20T12:02:34.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 >> v1:172.21.15.164:6789/0 conn(0x7fa5d0063e80 legacy=0x7fa5d00bb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa5bc003950 0x7fa5bc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5bc004520 0x7fa5bc0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.349 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc004e90 0x7fa5bc00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00bcb40 con 0x7fa5bc003950 2020-11-20T12:02:34.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc00bc60 con 0x7fa5bc004e90 2020-11-20T12:02:34.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc00bdd0 con 0x7fa5bc004520 2020-11-20T12:02:34.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5d48a2700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc004e90 0x7fa5bc00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.350 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5cf7fe700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5bc004520 0x7fa5bc0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.351 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5cffff700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa5bc003950 0x7fa5bc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.351 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5d48a2700 1 -- 172.21.15.164:0/2896078585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5bc004520 msgr2=0x7fa5bc0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:34.351 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5d48a2700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5bc004520 0x7fa5bc0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.351 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5d48a2700 1 -- 172.21.15.164:0/2896078585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa5bc003950 msgr2=0x7fa5bc003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:34.352 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5d48a2700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa5bc003950 0x7fa5bc003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.352 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5d48a2700 1 -- 172.21.15.164:0/2896078585 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc003280 con 0x7fa5bc004e90 2020-11-20T12:02:34.352 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5cffff700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa5bc003950 0x7fa5bc003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:34.352 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5d48a2700 1 -- 172.21.15.164:0/2896078585 reap_dead start 2020-11-20T12:02:34.352 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5d48a2700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc004e90 0x7fa5bc00b770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fa5c800ae80 tx=0x7fa5c800a3c0).ready entity=mon.1 client_cookie=73178fd3536a8bf0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800a7b0 con 0x7fa5bc004e90 2020-11-20T12:02:34.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.339+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c800fd70 con 0x7fa5bc004e90 2020-11-20T12:02:34.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.340+0000 7fa5ceffd700 1 -- 172.21.15.164:0/2896078585 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800fee0 con 0x7fa5bc004e90 2020-11-20T12:02:34.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.340+0000 7fa5d6305700 1 -- 172.21.15.164:0/2896078585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc004e90 msgr2=0x7fa5bc00b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.353 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.340+0000 7fa5d6305700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc004e90 0x7fa5bc00b770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fa5c800ae80 tx=0x7fa5c800a3c0).stop 2020-11-20T12:02:34.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.340+0000 7fa5d6305700 1 -- 172.21.15.164:0/2896078585 shutdown_connections 2020-11-20T12:02:34.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.340+0000 7fa5d6305700 1 --2- 172.21.15.164:0/2896078585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc004e90 0x7fa5bc00b770 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.340+0000 7fa5d6305700 1 -- 172.21.15.164:0/2896078585 >> 172.21.15.164:0/2896078585 conn(0x7fa5d0060c80 msgr2=0x7fa5d00c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:34.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.340+0000 7fa5d6305700 1 -- 172.21.15.164:0/2896078585 shutdown_connections 2020-11-20T12:02:34.354 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.340+0000 7fa5d6305700 1 -- 172.21.15.164:0/2896078585 wait complete. 2020-11-20T12:02:34.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.341+0000 7fa5d6305700 1 Processor -- start 2020-11-20T12:02:34.355 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.341+0000 7fa5d6305700 1 -- start start 2020-11-20T12:02:34.357 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d6305700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5bc004e90 0x7fa5d00c3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.358 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d6305700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa5d00c3a70 0x7fa5d015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.358 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d6305700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5d015e7c0 0x7fa5d0145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.358 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d6305700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0151c60 con 0x7fa5d00c3a70 2020-11-20T12:02:34.358 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d6305700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0151f00 con 0x7fa5d015e7c0 2020-11-20T12:02:34.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d6305700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d01521a0 con 0x7fa5bc004e90 2020-11-20T12:02:34.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d48a2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5d015e7c0 0x7fa5d0145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d48a2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5d015e7c0 0x7fa5d0145530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46492/0 (socket says 172.21.15.164:46492) 2020-11-20T12:02:34.359 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d48a2700 1 -- 172.21.15.164:0/2119525760 learned_addr learned my addr 172.21.15.164:0/2119525760 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:34.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5cffff700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5bc004e90 0x7fa5d00c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5cf7fe700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa5d00c3a70 0x7fa5d015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d48a2700 1 -- 172.21.15.164:0/2119525760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5bc004e90 msgr2=0x7fa5d00c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d48a2700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5bc004e90 0x7fa5d00c3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.360 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d48a2700 1 -- 172.21.15.164:0/2119525760 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa5d00c3a70 msgr2=0x7fa5d015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d48a2700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa5d00c3a70 0x7fa5d015e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.342+0000 7fa5d48a2700 1 -- 172.21.15.164:0/2119525760 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d0152440 con 0x7fa5d015e7c0 2020-11-20T12:02:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.343+0000 7fa5d48a2700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5d015e7c0 0x7fa5d0145530 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fa5c8009000 tx=0x7fa5c800a3c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.343+0000 7fa5affff700 1 -- 172.21.15.164:0/2119525760 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8020070 con 0x7fa5d015e7c0 2020-11-20T12:02:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.343+0000 7fa5affff700 1 -- 172.21.15.164:0/2119525760 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c801a400 con 0x7fa5d015e7c0 2020-11-20T12:02:34.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.343+0000 7fa5affff700 1 -- 172.21.15.164:0/2119525760 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c801a7a0 con 0x7fa5d015e7c0 2020-11-20T12:02:34.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.343+0000 7fa5d6305700 1 -- 172.21.15.164:0/2119525760 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d01526e0 con 0x7fa5d015e7c0 2020-11-20T12:02:34.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.343+0000 7fa5d6305700 1 -- 172.21.15.164:0/2119525760 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d0141c20 con 0x7fa5d015e7c0 2020-11-20T12:02:34.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.344+0000 7fa5d6305700 1 -- 172.21.15.164:0/2119525760 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d0152870 con 0x7fa5d015e7c0 2020-11-20T12:02:34.362 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.344+0000 7fa5affff700 1 -- 172.21.15.164:0/2119525760 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa5c800e040 con 0x7fa5d015e7c0 2020-11-20T12:02:34.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.345+0000 7fa5affff700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa5a8080670 0x7fa5a8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.345+0000 7fa5affff700 1 -- 172.21.15.164:0/2119525760 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa5c80a3800 con 0x7fa5d015e7c0 2020-11-20T12:02:34.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.345+0000 7fa5cffff700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa5a8080670 0x7fa5a8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.345+0000 7fa5cffff700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa5a8080670 0x7fa5a8082b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa5c0000c00 tx=0x7fa5c000c040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.363 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.348+0000 7fa5affff700 1 -- 172.21.15.164:0/2119525760 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa5c8078210 con 0x7fa5d015e7c0 2020-11-20T12:02:34.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.488+0000 7fa5d6305700 1 -- 172.21.15.164:0/2119525760 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5d0069b70 con 0x7fa5a8080670 2020-11-20T12:02:34.492 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.488+0000 7fa5affff700 1 -- 172.21.15.164:0/2119525760 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa5d0069b70 con 0x7fa5a8080670 2020-11-20T12:02:34.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 -- 172.21.15.164:0/2119525760 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa5a8080670 msgr2=0x7fa5a8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.494 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa5a8080670 0x7fa5a8082b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa5c0000c00 tx=0x7fa5c000c040).stop 2020-11-20T12:02:34.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 -- 172.21.15.164:0/2119525760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5d015e7c0 msgr2=0x7fa5d0145530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5d015e7c0 0x7fa5d0145530 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fa5c8009000 tx=0x7fa5c800a3c0).stop 2020-11-20T12:02:34.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 -- 172.21.15.164:0/2119525760 shutdown_connections 2020-11-20T12:02:34.495 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fa5a8080670 0x7fa5a8082b30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5d015e7c0 0x7fa5d0145530 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5bc004e90 0x7fa5d00c3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 --2- 172.21.15.164:0/2119525760 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa5d00c3a70 0x7fa5d015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.496 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 -- 172.21.15.164:0/2119525760 >> 172.21.15.164:0/2119525760 conn(0x7fa5d0060c80 msgr2=0x7fa5d00c15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:34.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 -- 172.21.15.164:0/2119525760 shutdown_connections 2020-11-20T12:02:34.497 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.490+0000 7fa5d6305700 1 -- 172.21.15.164:0/2119525760 wait complete. 2020-11-20T12:02:34.497 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 5 to deep-scrub 2020-11-20T12:02:34.505 INFO:tasks.ceph:Scrubbing osd.8 2020-11-20T12:02:34.506 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.616+0000 7f88a68f6700 1 Processor -- start 2020-11-20T12:02:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.616+0000 7f88a68f6700 1 -- start start 2020-11-20T12:02:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.617+0000 7f88a68f6700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f88a0150c50 0x7f88a00bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.617+0000 7f88a68f6700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a0154660 con 0x7f88a0063940 2020-11-20T12:02:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.617+0000 7f88a68f6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a0154900 con 0x7f88a00bf000 2020-11-20T12:02:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.617+0000 7f88a68f6700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a0154ba0 con 0x7f88a0150c50 2020-11-20T12:02:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.617+0000 7f889ffff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f88a00bf000 0x7f88a0150540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56238/0 (socket says 172.21.15.164:56238) 2020-11-20T12:02:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.617+0000 7f889ffff700 1 -- 172.21.15.164:0/4015561477 learned_addr learned my addr 172.21.15.164:0/4015561477 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.617+0000 7f889f7fe700 1 --2- 172.21.15.164:0/4015561477 >> v2:172.21.15.188:3300/0 conn(0x7f88a0150c50 0x7f88a00bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.617+0000 7f889effd700 1 -- 172.21.15.164:0/4015561477 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336695742 0 0) 0x7f88a0154900 con 0x7f88a00bf000 2020-11-20T12:02:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.617+0000 7f889effd700 1 -- 172.21.15.164:0/4015561477 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f888c003280 con 0x7f88a00bf000 2020-11-20T12:02:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f889f7fe700 1 -- 172.21.15.164:0/4015561477 >> v1:172.21.15.164:6789/0 conn(0x7f88a00bf000 legacy=0x7f88a0150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f889f7fe700 1 -- 172.21.15.164:0/4015561477 >> v1:172.21.15.36:6789/0 conn(0x7f88a0063940 legacy=0x7f88a0063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f889f7fe700 1 -- 172.21.15.164:0/4015561477 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0154e40 con 0x7f88a0150c50 2020-11-20T12:02:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f889f7fe700 1 --2- 172.21.15.164:0/4015561477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88a0150c50 0x7f88a00bf3e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f8894006fd0 tx=0x7f8894006e30).ready entity=mon.2 client_cookie=3590cf2495dc484b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f889effd700 1 -- 172.21.15.164:0/4015561477 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88940097e0 con 0x7f88a0150c50 2020-11-20T12:02:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f889effd700 1 -- 172.21.15.164:0/4015561477 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8894000e90 con 0x7f88a0150c50 2020-11-20T12:02:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f889effd700 1 -- 172.21.15.164:0/4015561477 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894009b50 con 0x7f88a0150c50 2020-11-20T12:02:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f88a68f6700 1 -- 172.21.15.164:0/4015561477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88a0150c50 msgr2=0x7f88a00bf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f88a68f6700 1 --2- 172.21.15.164:0/4015561477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88a0150c50 0x7f88a00bf3e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f8894006fd0 tx=0x7f8894006e30).stop 2020-11-20T12:02:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f88a68f6700 1 -- 172.21.15.164:0/4015561477 shutdown_connections 2020-11-20T12:02:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f88a68f6700 1 --2- 172.21.15.164:0/4015561477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88a0150c50 0x7f88a00bf3e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f88a68f6700 1 -- 172.21.15.164:0/4015561477 >> 172.21.15.164:0/4015561477 conn(0x7f88a00612c0 msgr2=0x7f88a00616d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f88a68f6700 1 -- 172.21.15.164:0/4015561477 shutdown_connections 2020-11-20T12:02:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.618+0000 7f88a68f6700 1 -- 172.21.15.164:0/4015561477 wait complete. 2020-11-20T12:02:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.619+0000 7f88a68f6700 1 Processor -- start 2020-11-20T12:02:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.620+0000 7f88a68f6700 1 -- start start 2020-11-20T12:02:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.620+0000 7f88a68f6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88a0063940 0x7f88a01641b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.632 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.620+0000 7f88a68f6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88a00bf000 0x7f88a00bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.632 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.620+0000 7f88a68f6700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88a0150c50 0x7f88a01578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.632 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.620+0000 7f88a68f6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00c4f60 con 0x7f88a00bf000 2020-11-20T12:02:34.632 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.620+0000 7f88a68f6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00c5200 con 0x7f88a0063940 2020-11-20T12:02:34.633 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.620+0000 7f88a68f6700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0160250 con 0x7f88a0150c50 2020-11-20T12:02:34.633 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.620+0000 7f889ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88a0063940 0x7f88a01641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.633 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.620+0000 7f889ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88a0063940 0x7f88a01641b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46504/0 (socket says 172.21.15.164:46504) 2020-11-20T12:02:34.633 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f889ffff700 1 -- 172.21.15.164:0/3291798995 learned_addr learned my addr 172.21.15.164:0/3291798995 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:34.634 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f88a4e93700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88a0150c50 0x7f88a01578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.634 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f889f7fe700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88a00bf000 0x7f88a00bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.634 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f889ffff700 1 -- 172.21.15.164:0/3291798995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88a0150c50 msgr2=0x7f88a01578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.635 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f889ffff700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88a0150c50 0x7f88a01578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.635 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f889ffff700 1 -- 172.21.15.164:0/3291798995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88a00bf000 msgr2=0x7f88a00bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.635 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f889ffff700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88a00bf000 0x7f88a00bcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.635 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f889ffff700 1 -- 172.21.15.164:0/3291798995 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a01604f0 con 0x7f88a0063940 2020-11-20T12:02:34.636 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f889f7fe700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88a00bf000 0x7f88a00bcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:34.637 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f889ffff700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88a0063940 0x7f88a01641b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f889000c740 tx=0x7f8890007b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.637 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f887ffff700 1 -- 172.21.15.164:0/3291798995 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890007320 con 0x7f88a0063940 2020-11-20T12:02:34.637 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f887ffff700 1 -- 172.21.15.164:0/3291798995 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8890007480 con 0x7f88a0063940 2020-11-20T12:02:34.637 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f88a68f6700 1 -- 172.21.15.164:0/3291798995 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a0160790 con 0x7f88a0063940 2020-11-20T12:02:34.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f887ffff700 1 -- 172.21.15.164:0/3291798995 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890005860 con 0x7f88a0063940 2020-11-20T12:02:34.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.621+0000 7f88a68f6700 1 -- 172.21.15.164:0/3291798995 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a0160ed0 con 0x7f88a0063940 2020-11-20T12:02:34.638 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.622+0000 7f887dffb700 1 -- 172.21.15.164:0/3291798995 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8870000fc0 con 0x7f88a0063940 2020-11-20T12:02:34.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.623+0000 7f887ffff700 1 -- 172.21.15.164:0/3291798995 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8890019020 con 0x7f88a0063940 2020-11-20T12:02:34.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.623+0000 7f887ffff700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8878080670 0x7f8878082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.623+0000 7f887ffff700 1 -- 172.21.15.164:0/3291798995 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f88900a2830 con 0x7f88a0063940 2020-11-20T12:02:34.639 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.623+0000 7f889f7fe700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8878080670 0x7f8878082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.623+0000 7f887ffff700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] conn(0x7f88780893a0 0x7f887808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.623+0000 7f887ffff700 1 -- 172.21.15.164:0/3291798995 --> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f887808be20 con 0x7f88780893a0 2020-11-20T12:02:34.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.623+0000 7f887ffff700 1 -- 172.21.15.164:0/3291798995 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88900a2ba0 con 0x7f88a0063940 2020-11-20T12:02:34.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.624+0000 7f889f7fe700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8878080670 0x7f8878082b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f8894006fd0 tx=0x7f8894015000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.640 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.624+0000 7f88a4e93700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] conn(0x7f88780893a0 0x7f887808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.624+0000 7f88a4e93700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] conn(0x7f88780893a0 0x7f887808b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.641 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.625+0000 7f887ffff700 1 -- 172.21.15.164:0/3291798995 <== osd.8 v2:172.21.15.188:6824/23470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f887808be20 con 0x7f88780893a0 2020-11-20T12:02:34.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.637+0000 7f887dffb700 1 -- 172.21.15.164:0/3291798995 --> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8870002a30 con 0x7f88780893a0 2020-11-20T12:02:34.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887ffff700 1 -- 172.21.15.164:0/3291798995 <== osd.8 v2:172.21.15.188:6824/23470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8870002a30 con 0x7f88780893a0 2020-11-20T12:02:34.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887dffb700 1 -- 172.21.15.164:0/3291798995 >> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] conn(0x7f88780893a0 msgr2=0x7f887808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.643 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887dffb700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.188:6824/23470,v1:172.21.15.188:6825/23470] conn(0x7f88780893a0 0x7f887808b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887dffb700 1 -- 172.21.15.164:0/3291798995 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8878080670 msgr2=0x7f8878082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887dffb700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f8878080670 0x7f8878082b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f8894006fd0 tx=0x7f8894015000).stop 2020-11-20T12:02:34.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887dffb700 1 -- 172.21.15.164:0/3291798995 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88a0063940 msgr2=0x7f88a01641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.644 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887dffb700 1 --2- 172.21.15.164:0/3291798995 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88a0063940 0x7f88a01641b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f889000c740 tx=0x7f8890007b00).stop 2020-11-20T12:02:34.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f88a4e93700 1 -- 172.21.15.164:0/3291798995 reap_dead start 2020-11-20T12:02:34.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887dffb700 1 -- 172.21.15.164:0/3291798995 shutdown_connections 2020-11-20T12:02:34.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887dffb700 1 -- 172.21.15.164:0/3291798995 >> 172.21.15.164:0/3291798995 conn(0x7f88a00612c0 msgr2=0x7f88a00bd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:34.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887dffb700 1 -- 172.21.15.164:0/3291798995 shutdown_connections 2020-11-20T12:02:34.645 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.638+0000 7f887dffb700 1 -- 172.21.15.164:0/3291798995 wait complete. 2020-11-20T12:02:34.646 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:34.646 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:34.646 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:34.654 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2020-11-20T12:02:34.766 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.762+0000 7f51ed1f0700 1 Processor -- start 2020-11-20T12:02:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.763+0000 7f51ed1f0700 1 -- start start 2020-11-20T12:02:34.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.763+0000 7f51ed1f0700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f51e81548c0 0x7f51e80bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.763+0000 7f51ed1f0700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f51e80c11a0 0x7f51e8154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.763+0000 7f51ed1f0700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e80621d0 con 0x7f51e8155190 2020-11-20T12:02:34.769 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.763+0000 7f51ed1f0700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e8062970 con 0x7f51e80c11a0 2020-11-20T12:02:34.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.763+0000 7f51ed1f0700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e8061fe0 con 0x7f51e81548c0 2020-11-20T12:02:34.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e77fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f51e80c11a0 0x7f51e8154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e77fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f51e80c11a0 0x7f51e8154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46514/0 (socket says 172.21.15.164:46514) 2020-11-20T12:02:34.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e77fe700 1 -- 172.21.15.164:0/3689586900 learned_addr learned my addr 172.21.15.164:0/3689586900 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:34.770 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e7fff700 1 --2- 172.21.15.164:0/3689586900 >> v2:172.21.15.188:3300/0 conn(0x7f51e81548c0 0x7f51e80bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.771 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e77fe700 1 -- 172.21.15.164:0/3689586900 >> v2:172.21.15.188:3300/0 conn(0x7f51e81548c0 msgr2=0x7f51e80bffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:34.771 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e77fe700 1 --2- 172.21.15.164:0/3689586900 >> v2:172.21.15.188:3300/0 conn(0x7f51e81548c0 0x7f51e80bffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.771 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e77fe700 1 -- 172.21.15.164:0/3689586900 >> v1:172.21.15.188:6789/0 conn(0x7f51e8155190 legacy=0x7f51e8065f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.771 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e77fe700 1 -- 172.21.15.164:0/3689586900 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8062430 con 0x7f51e80c11a0 2020-11-20T12:02:34.771 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e77fe700 1 --2- 172.21.15.164:0/3689586900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e80c11a0 0x7f51e8154ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f51e80bc430 tx=0x7f51dc006ef0).ready entity=mon.1 client_cookie=586fe1ab50d35f63 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e6ffd700 1 -- 172.21.15.164:0/3689586900 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00b860 con 0x7f51e80c11a0 2020-11-20T12:02:34.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e6ffd700 1 -- 172.21.15.164:0/3689586900 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc000e90 con 0x7f51e80c11a0 2020-11-20T12:02:34.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.764+0000 7f51e6ffd700 1 -- 172.21.15.164:0/3689586900 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00bbd0 con 0x7f51e80c11a0 2020-11-20T12:02:34.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.765+0000 7f51ed1f0700 1 -- 172.21.15.164:0/3689586900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e80c11a0 msgr2=0x7f51e8154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.772 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.765+0000 7f51ed1f0700 1 --2- 172.21.15.164:0/3689586900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e80c11a0 0x7f51e8154ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f51e80bc430 tx=0x7f51dc006ef0).stop 2020-11-20T12:02:34.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.765+0000 7f51ed1f0700 1 -- 172.21.15.164:0/3689586900 shutdown_connections 2020-11-20T12:02:34.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.765+0000 7f51ed1f0700 1 --2- 172.21.15.164:0/3689586900 >> v2:172.21.15.188:3300/0 conn(0x7f51e81548c0 0x7f51e80bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.765+0000 7f51ed1f0700 1 --2- 172.21.15.164:0/3689586900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e80c11a0 0x7f51e8154ca0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.765+0000 7f51ed1f0700 1 -- 172.21.15.164:0/3689586900 >> 172.21.15.164:0/3689586900 conn(0x7f51e80c5410 msgr2=0x7f51e80c5820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:34.773 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.765+0000 7f51ed1f0700 1 -- 172.21.15.164:0/3689586900 shutdown_connections 2020-11-20T12:02:34.774 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.765+0000 7f51ed1f0700 1 -- 172.21.15.164:0/3689586900 wait complete. 2020-11-20T12:02:34.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.766+0000 7f51ed1f0700 1 Processor -- start 2020-11-20T12:02:34.776 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.766+0000 7f51ed1f0700 1 -- start start 2020-11-20T12:02:34.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51ed1f0700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51e80c11a0 0x7f51e814bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51ed1f0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e81548c0 0x7f51e80c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51ed1f0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e8155190 0x7f51e80be480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.777 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51ed1f0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8153cf0 con 0x7f51e8155190 2020-11-20T12:02:34.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51ed1f0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8153f90 con 0x7f51e81548c0 2020-11-20T12:02:34.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51ed1f0700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8154230 con 0x7f51e80c11a0 2020-11-20T12:02:34.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51e77fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e81548c0 0x7f51e80c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51e77fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e81548c0 0x7f51e80c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46520/0 (socket says 172.21.15.164:46520) 2020-11-20T12:02:34.778 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51e77fe700 1 -- 172.21.15.164:0/636151793 learned_addr learned my addr 172.21.15.164:0/636151793 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:34.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51e7fff700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51e80c11a0 0x7f51e814bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51ec9ef700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e8155190 0x7f51e80be480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51e77fe700 1 -- 172.21.15.164:0/636151793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51e80c11a0 msgr2=0x7f51e814bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51e77fe700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51e80c11a0 0x7f51e814bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51e77fe700 1 -- 172.21.15.164:0/636151793 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e8155190 msgr2=0x7f51e80be480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51e77fe700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e8155190 0x7f51e80be480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51e77fe700 1 -- 172.21.15.164:0/636151793 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e81544d0 con 0x7f51e81548c0 2020-11-20T12:02:34.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51e77fe700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e81548c0 0x7f51e80c42a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f51dc00c010 tx=0x7f51dc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51c7fff700 1 -- 172.21.15.164:0/636151793 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc011be0 con 0x7f51e81548c0 2020-11-20T12:02:34.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51c7fff700 1 -- 172.21.15.164:0/636151793 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc011d40 con 0x7f51e81548c0 2020-11-20T12:02:34.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51ed1f0700 1 -- 172.21.15.164:0/636151793 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e8163b70 con 0x7f51e81548c0 2020-11-20T12:02:34.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.767+0000 7f51c7fff700 1 -- 172.21.15.164:0/636151793 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc01d6d0 con 0x7f51e81548c0 2020-11-20T12:02:34.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.768+0000 7f51ed1f0700 1 -- 172.21.15.164:0/636151793 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e814c2e0 con 0x7f51e81548c0 2020-11-20T12:02:34.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.768+0000 7f51ed1f0700 1 -- 172.21.15.164:0/636151793 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e8153a90 con 0x7f51e81548c0 2020-11-20T12:02:34.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.769+0000 7f51c7fff700 1 -- 172.21.15.164:0/636151793 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f51dc017070 con 0x7f51e81548c0 2020-11-20T12:02:34.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.769+0000 7f51c7fff700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f51c0080670 0x7f51c0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:34.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.770+0000 7f51c7fff700 1 -- 172.21.15.164:0/636151793 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f51dc0a5270 con 0x7f51e81548c0 2020-11-20T12:02:34.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.770+0000 7f51e7fff700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f51c0080670 0x7f51c0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:34.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.770+0000 7f51e7fff700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f51c0080670 0x7f51c0082b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f51d800ba40 tx=0x7f51d8008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:34.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.772+0000 7f51c7fff700 1 -- 172.21.15.164:0/636151793 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f51dc079c80 con 0x7f51e81548c0 2020-11-20T12:02:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.912+0000 7f51ed1f0700 1 -- 172.21.15.164:0/636151793 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) v1 -- 0x7f51e8163d00 con 0x7f51c0080670 2020-11-20T12:02:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.913+0000 7f51c7fff700 1 -- 172.21.15.164:0/636151793 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f51e8163d00 con 0x7f51c0080670 2020-11-20T12:02:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 -- 172.21.15.164:0/636151793 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f51c0080670 msgr2=0x7f51c0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f51c0080670 0x7f51c0082b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f51d800ba40 tx=0x7f51d8008040).stop 2020-11-20T12:02:34.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 -- 172.21.15.164:0/636151793 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e81548c0 msgr2=0x7f51e80c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:34.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e81548c0 0x7f51e80c42a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f51dc00c010 tx=0x7f51dc016000).stop 2020-11-20T12:02:34.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 -- 172.21.15.164:0/636151793 shutdown_connections 2020-11-20T12:02:34.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f51c0080670 0x7f51c0082b30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.920 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e8155190 0x7f51e80be480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51e80c11a0 0x7f51e814bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 --2- 172.21.15.164:0/636151793 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51e81548c0 0x7f51e80c42a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 -- 172.21.15.164:0/636151793 >> 172.21.15.164:0/636151793 conn(0x7f51e80c5410 msgr2=0x7f51e80bb220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 -- 172.21.15.164:0/636151793 shutdown_connections 2020-11-20T12:02:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:34.914+0000 7f51ed1f0700 1 -- 172.21.15.164:0/636151793 wait complete. 2020-11-20T12:02:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 8 to deep-scrub 2020-11-20T12:02:34.930 INFO:tasks.ceph:Scrubbing osd.11 2020-11-20T12:02:34.931 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:02:35.044 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.040+0000 7f739359e700 1 Processor -- start 2020-11-20T12:02:35.045 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.040+0000 7f739359e700 1 -- start start 2020-11-20T12:02:35.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.041+0000 7f739359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7394061d70 0x7f73940c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.041+0000 7f739359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739409eee0 con 0x7f7394060960 2020-11-20T12:02:35.048 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.041+0000 7f739359e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73940610f0 con 0x7f73940c76c0 2020-11-20T12:02:35.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.041+0000 7f739359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7394061390 con 0x7f7394061d70 2020-11-20T12:02:35.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.041+0000 7f739259c700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f73940c76c0 0x7f7394152410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56266/0 (socket says 172.21.15.164:56266) 2020-11-20T12:02:35.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.041+0000 7f739259c700 1 -- 172.21.15.164:0/1081858981 learned_addr learned my addr 172.21.15.164:0/1081858981 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:35.049 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.041+0000 7f738bfff700 1 --2- 172.21.15.164:0/1081858981 >> v2:172.21.15.36:3300/0 conn(0x7f7394061d70 0x7f73940c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.041+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679846441 0 0) 0x7f73940610f0 con 0x7f73940c76c0 2020-11-20T12:02:35.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.041+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7374003280 con 0x7f73940c76c0 2020-11-20T12:02:35.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3937651893 0 0) 0x7f7374003280 con 0x7f73940c76c0 2020-11-20T12:02:35.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 >> v2:172.21.15.36:3300/0 conn(0x7f7394061d70 msgr2=0x7f73940c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:35.050 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 --2- 172.21.15.164:0/1081858981 >> v2:172.21.15.36:3300/0 conn(0x7f7394061d70 0x7f73940c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.051 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 >> v1:172.21.15.36:6789/0 conn(0x7f7394060960 legacy=0x7f739414dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.051 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394061630 con 0x7f73940c76c0 2020-11-20T12:02:35.051 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7f7384001520 con 0x7f73940c76c0 2020-11-20T12:02:35.051 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 >> v1:172.21.15.164:6789/0 conn(0x7f73940c76c0 legacy=0x7f7394152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.051 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73740037c0 0x7f7374003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.052 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7374004520 0x7f73740049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.052 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 0x7f737400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.052 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7394061390 con 0x7f73740037c0 2020-11-20T12:02:35.052 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7374005340 con 0x7f7374004e90 2020-11-20T12:02:35.052 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737400bc60 con 0x7f7374004520 2020-11-20T12:02:35.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7392d9d700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 0x7f737400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f739259c700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73740037c0 0x7f7374003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f738bfff700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7374004520 0x7f73740049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7392d9d700 1 -- 172.21.15.164:0/1081858981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7374004520 msgr2=0x7f73740049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:35.053 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7392d9d700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7374004520 0x7f73740049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.054 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7392d9d700 1 -- 172.21.15.164:0/1081858981 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73740037c0 msgr2=0x7f7374003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:35.054 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7392d9d700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73740037c0 0x7f7374003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.054 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7392d9d700 1 -- 172.21.15.164:0/1081858981 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374003280 con 0x7f7374004e90 2020-11-20T12:02:35.054 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7392d9d700 1 -- 172.21.15.164:0/1081858981 reap_dead start 2020-11-20T12:02:35.054 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7392d9d700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 0x7f737400b770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f738c001ef0 tx=0x7f738c007f50).ready entity=mon.1 client_cookie=cac8bba3560e4842 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:35.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c00c9e0 con 0x7f7374004e90 2020-11-20T12:02:35.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.042+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c00cb40 con 0x7f7374004e90 2020-11-20T12:02:35.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.043+0000 7f7391d9b700 1 -- 172.21.15.164:0/1081858981 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0068b0 con 0x7f7374004e90 2020-11-20T12:02:35.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.043+0000 7f739359e700 1 -- 172.21.15.164:0/1081858981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 msgr2=0x7f737400b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.055 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.043+0000 7f739359e700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 0x7f737400b770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f738c001ef0 tx=0x7f738c007f50).stop 2020-11-20T12:02:35.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.043+0000 7f739359e700 1 -- 172.21.15.164:0/1081858981 shutdown_connections 2020-11-20T12:02:35.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.043+0000 7f739359e700 1 --2- 172.21.15.164:0/1081858981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 0x7f737400b770 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.043+0000 7f739359e700 1 -- 172.21.15.164:0/1081858981 >> 172.21.15.164:0/1081858981 conn(0x7f739407ffb0 msgr2=0x7f73940803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:35.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.043+0000 7f739359e700 1 -- 172.21.15.164:0/1081858981 shutdown_connections 2020-11-20T12:02:35.056 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.043+0000 7f739359e700 1 -- 172.21.15.164:0/1081858981 wait complete. 2020-11-20T12:02:35.057 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.044+0000 7f739359e700 1 Processor -- start 2020-11-20T12:02:35.057 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.044+0000 7f739359e700 1 -- start start 2020-11-20T12:02:35.060 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739359e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 0x7f7394151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.060 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7394151e60 0x7f73941560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.060 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739359e700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7394152340 0x7f73941565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.060 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739414fab0 con 0x7f7394151e60 2020-11-20T12:02:35.061 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739359e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739414fd50 con 0x7f7374004e90 2020-11-20T12:02:35.061 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739359e700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739414fff0 con 0x7f7394152340 2020-11-20T12:02:35.061 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739259c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 0x7f7394151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.061 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739259c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 0x7f7394151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46540/0 (socket says 172.21.15.164:46540) 2020-11-20T12:02:35.061 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739259c700 1 -- 172.21.15.164:0/3686101692 learned_addr learned my addr 172.21.15.164:0/3686101692 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:35.062 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f7392d9d700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7394152340 0x7f73941565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.062 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f738bfff700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7394151e60 0x7f73941560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.062 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739259c700 1 -- 172.21.15.164:0/3686101692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7394152340 msgr2=0x7f73941565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.062 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739259c700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7394152340 0x7f73941565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.062 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739259c700 1 -- 172.21.15.164:0/3686101692 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7394151e60 msgr2=0x7f73941560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739259c700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7394151e60 0x7f73941560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739259c700 1 -- 172.21.15.164:0/3686101692 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394150290 con 0x7f7374004e90 2020-11-20T12:02:35.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.045+0000 7f739259c700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 0x7f7394151970 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f7384004b40 tx=0x7f7394060fe0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:35.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.046+0000 7f738a7fc700 1 -- 172.21.15.164:0/3686101692 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400f960 con 0x7f7374004e90 2020-11-20T12:02:35.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.046+0000 7f738a7fc700 1 -- 172.21.15.164:0/3686101692 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400fac0 con 0x7f7374004e90 2020-11-20T12:02:35.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.046+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7394150530 con 0x7f7374004e90 2020-11-20T12:02:35.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.046+0000 7f738a7fc700 1 -- 172.21.15.164:0/3686101692 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400fe80 con 0x7f7374004e90 2020-11-20T12:02:35.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.046+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739414b730 con 0x7f7374004e90 2020-11-20T12:02:35.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.046+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7394150730 con 0x7f7374004e90 2020-11-20T12:02:35.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.047+0000 7f738a7fc700 1 -- 172.21.15.164:0/3686101692 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7384012560 con 0x7f7374004e90 2020-11-20T12:02:35.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.048+0000 7f738a7fc700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7370080670 0x7f7370082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.048+0000 7f738a7fc700 1 -- 172.21.15.164:0/3686101692 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f73840a2930 con 0x7f7374004e90 2020-11-20T12:02:35.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.048+0000 7f738bfff700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7370080670 0x7f7370082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.048+0000 7f738a7fc700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] conn(0x7f73700893a0 0x7f737008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.048+0000 7f738a7fc700 1 -- 172.21.15.164:0/3686101692 --> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f737008be20 con 0x7f73700893a0 2020-11-20T12:02:35.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.048+0000 7f738a7fc700 1 -- 172.21.15.164:0/3686101692 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73840a2ca0 con 0x7f7374004e90 2020-11-20T12:02:35.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.048+0000 7f738bfff700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7370080670 0x7f7370082b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f737c006ad0 tx=0x7f737c008040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:35.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.048+0000 7f7392d9d700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] conn(0x7f73700893a0 0x7f737008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.049+0000 7f7392d9d700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] conn(0x7f73700893a0 0x7f737008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:35.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.050+0000 7f738a7fc700 1 -- 172.21.15.164:0/3686101692 <== osd.11 v2:172.21.15.188:6815/23471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f737008be20 con 0x7f73700893a0 2020-11-20T12:02:35.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.062+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 --> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f73940c24e0 con 0x7f73700893a0 2020-11-20T12:02:35.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.062+0000 7f738a7fc700 1 -- 172.21.15.164:0/3686101692 <== osd.11 v2:172.21.15.188:6815/23471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f73940c24e0 con 0x7f73700893a0 2020-11-20T12:02:35.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 >> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] conn(0x7f73700893a0 msgr2=0x7f737008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.068 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f739359e700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.188:6815/23471,v1:172.21.15.188:6817/23471] conn(0x7f73700893a0 0x7f737008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7370080670 msgr2=0x7f7370082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f739359e700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f7370080670 0x7f7370082b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f737c006ad0 tx=0x7f737c008040).stop 2020-11-20T12:02:35.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 msgr2=0x7f7394151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f739359e700 1 --2- 172.21.15.164:0/3686101692 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7374004e90 0x7f7394151970 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f7384004b40 tx=0x7f7394060fe0).stop 2020-11-20T12:02:35.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f7392d9d700 1 -- 172.21.15.164:0/3686101692 reap_dead start 2020-11-20T12:02:35.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 shutdown_connections 2020-11-20T12:02:35.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 >> 172.21.15.164:0/3686101692 conn(0x7f739407ffb0 msgr2=0x7f73940bf280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:35.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 shutdown_connections 2020-11-20T12:02:35.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.063+0000 7f739359e700 1 -- 172.21.15.164:0/3686101692 wait complete. 2020-11-20T12:02:35.071 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2020-11-20T12:02:35.071 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:02:35.071 INFO:teuthology.orchestra.run.smithi164.stdout:} 2020-11-20T12:02:35.079 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2020-11-20T12:02:35.189 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.185+0000 7fc188e62700 1 Processor -- start 2020-11-20T12:02:35.190 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.185+0000 7fc188e62700 1 -- start start 2020-11-20T12:02:35.192 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.186+0000 7fc188e62700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc1840bfd90 0x7fc1840c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.186+0000 7fc188e62700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1841555a0 con 0x7fc1840c4470 2020-11-20T12:02:35.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.186+0000 7fc188e62700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1841517d0 con 0x7fc1840bccf0 2020-11-20T12:02:35.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.186+0000 7fc188e62700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc184151a70 con 0x7fc1840bfd90 2020-11-20T12:02:35.193 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.186+0000 7fc17bfff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc1840bccf0 0x7fc1840bf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56290/0 (socket says 172.21.15.164:56290) 2020-11-20T12:02:35.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.186+0000 7fc17bfff700 1 -- 172.21.15.164:0/627156450 learned_addr learned my addr 172.21.15.164:0/627156450 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:35.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc182d9d700 1 --2- 172.21.15.164:0/627156450 >> v2:172.21.15.188:3300/0 conn(0x7fc1840bfd90 0x7fc1840c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc181d9b700 1 -- 172.21.15.164:0/627156450 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700232879 0 0) 0x7fc1841517d0 con 0x7fc1840bccf0 2020-11-20T12:02:35.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc181d9b700 1 -- 172.21.15.164:0/627156450 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc164003280 con 0x7fc1840bccf0 2020-11-20T12:02:35.194 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc182d9d700 1 -- 172.21.15.164:0/627156450 >> v1:172.21.15.164:6789/0 conn(0x7fc1840bccf0 legacy=0x7fc1840bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc181d9b700 1 -- 172.21.15.164:0/627156450 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3991415063 0 0) 0x7fc164003280 con 0x7fc1840bccf0 2020-11-20T12:02:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc182d9d700 1 -- 172.21.15.164:0/627156450 >> v1:172.21.15.36:6789/0 conn(0x7fc1840c4470 legacy=0x7fc1840c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc182d9d700 1 -- 172.21.15.164:0/627156450 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc184151d10 con 0x7fc1840bfd90 2020-11-20T12:02:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc182d9d700 1 --2- 172.21.15.164:0/627156450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1840bfd90 0x7fc1840c4850 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fc17c009c60 tx=0x7fc17c009220).ready entity=mon.2 client_cookie=9eb0c81fd584a792 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc181d9b700 1 -- 172.21.15.164:0/627156450 <== mon.2 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c001560 con 0x7fc1840bfd90 2020-11-20T12:02:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc181d9b700 1 -- 172.21.15.164:0/627156450 <== mon.2 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c00b7b0 con 0x7fc1840bfd90 2020-11-20T12:02:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.187+0000 7fc181d9b700 1 -- 172.21.15.164:0/627156450 <== mon.2 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00bb30 con 0x7fc1840bfd90 2020-11-20T12:02:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.188+0000 7fc188e62700 1 -- 172.21.15.164:0/627156450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1840bfd90 msgr2=0x7fc1840c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.188+0000 7fc188e62700 1 --2- 172.21.15.164:0/627156450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1840bfd90 0x7fc1840c4850 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fc17c009c60 tx=0x7fc17c009220).stop 2020-11-20T12:02:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.188+0000 7fc188e62700 1 -- 172.21.15.164:0/627156450 shutdown_connections 2020-11-20T12:02:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.188+0000 7fc188e62700 1 --2- 172.21.15.164:0/627156450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1840bfd90 0x7fc1840c4850 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.188+0000 7fc188e62700 1 -- 172.21.15.164:0/627156450 >> 172.21.15.164:0/627156450 conn(0x7fc1840683b0 msgr2=0x7fc184061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.188+0000 7fc188e62700 1 -- 172.21.15.164:0/627156450 shutdown_connections 2020-11-20T12:02:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.188+0000 7fc188e62700 1 -- 172.21.15.164:0/627156450 wait complete. 2020-11-20T12:02:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.189+0000 7fc188e62700 1 Processor -- start 2020-11-20T12:02:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.189+0000 7fc188e62700 1 -- start start 2020-11-20T12:02:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc188e62700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1840bccf0 0x7fc1840bd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc188e62700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1840bfd90 0x7fc184112490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc188e62700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1840c4470 0x7fc184112980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc188e62700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840c6980 con 0x7fc1840bfd90 2020-11-20T12:02:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc188e62700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840c6c20 con 0x7fc1840c4470 2020-11-20T12:02:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc188e62700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840c6ec0 con 0x7fc1840bccf0 2020-11-20T12:02:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc182d9d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1840c4470 0x7fc184112980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc182d9d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1840c4470 0x7fc184112980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46558/0 (socket says 172.21.15.164:46558) 2020-11-20T12:02:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc182d9d700 1 -- 172.21.15.164:0/337766336 learned_addr learned my addr 172.21.15.164:0/337766336 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc17bfff700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1840bfd90 0x7fc184112490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc18259c700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1840bccf0 0x7fc1840bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc182d9d700 1 -- 172.21.15.164:0/337766336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1840bccf0 msgr2=0x7fc1840bd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc182d9d700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1840bccf0 0x7fc1840bd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc182d9d700 1 -- 172.21.15.164:0/337766336 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1840bfd90 msgr2=0x7fc184112490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc182d9d700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1840bfd90 0x7fc184112490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc182d9d700 1 -- 172.21.15.164:0/337766336 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840c7160 con 0x7fc1840c4470 2020-11-20T12:02:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc18259c700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1840bccf0 0x7fc1840bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc17bfff700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1840bfd90 0x7fc184112490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc182d9d700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1840c4470 0x7fc184112980 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fc17c009260 tx=0x7fc17c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc17a7fc700 1 -- 172.21.15.164:0/337766336 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c01c5f0 con 0x7fc1840c4470 2020-11-20T12:02:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc17a7fc700 1 -- 172.21.15.164:0/337766336 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c01c750 con 0x7fc1840c4470 2020-11-20T12:02:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc17a7fc700 1 -- 172.21.15.164:0/337766336 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c01caf0 con 0x7fc1840c4470 2020-11-20T12:02:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc188e62700 1 -- 172.21.15.164:0/337766336 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1840c7400 con 0x7fc1840c4470 2020-11-20T12:02:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.190+0000 7fc188e62700 1 -- 172.21.15.164:0/337766336 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1840c65d0 con 0x7fc1840c4470 2020-11-20T12:02:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.191+0000 7fc188e62700 1 -- 172.21.15.164:0/337766336 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc184152bb0 con 0x7fc1840c4470 2020-11-20T12:02:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.192+0000 7fc17a7fc700 1 -- 172.21.15.164:0/337766336 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc17c017070 con 0x7fc1840c4470 2020-11-20T12:02:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.193+0000 7fc17a7fc700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1600806a0 0x7fc160082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.193+0000 7fc18259c700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1600806a0 0x7fc160082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.193+0000 7fc17a7fc700 1 -- 172.21.15.164:0/337766336 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc17c0a5010 con 0x7fc1840c4470 2020-11-20T12:02:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.193+0000 7fc18259c700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1600806a0 0x7fc160082b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fc174001570 tx=0x7fc174009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:35.210 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.196+0000 7fc17a7fc700 1 -- 172.21.15.164:0/337766336 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc17c079a20 con 0x7fc1840c4470 2020-11-20T12:02:35.340 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.336+0000 7fc188e62700 1 -- 172.21.15.164:0/337766336 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) v1 -- 0x7fc184069b70 con 0x7fc1600806a0 2020-11-20T12:02:35.340 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.336+0000 7fc17a7fc700 1 -- 172.21.15.164:0/337766336 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7fc184069b70 con 0x7fc1600806a0 2020-11-20T12:02:35.343 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 -- 172.21.15.164:0/337766336 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1600806a0 msgr2=0x7fc160082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.343 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1600806a0 0x7fc160082b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fc174001570 tx=0x7fc174009040).stop 2020-11-20T12:02:35.343 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 -- 172.21.15.164:0/337766336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1840c4470 msgr2=0x7fc184112980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.344 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1840c4470 0x7fc184112980 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fc17c009260 tx=0x7fc17c016000).stop 2020-11-20T12:02:35.344 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 -- 172.21.15.164:0/337766336 shutdown_connections 2020-11-20T12:02:35.344 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fc1600806a0 0x7fc160082b60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.344 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1840c4470 0x7fc184112980 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1840bccf0 0x7fc1840bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 --2- 172.21.15.164:0/337766336 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1840bfd90 0x7fc184112490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 -- 172.21.15.164:0/337766336 >> 172.21.15.164:0/337766336 conn(0x7fc1840683b0 msgr2=0x7fc184061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:35.345 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 -- 172.21.15.164:0/337766336 shutdown_connections 2020-11-20T12:02:35.346 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.338+0000 7fc188e62700 1 -- 172.21.15.164:0/337766336 wait complete. 2020-11-20T12:02:35.346 INFO:teuthology.orchestra.run.smithi164.stderr:instructed osd(s) 11 to deep-scrub 2020-11-20T12:02:35.354 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:02:35.467 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.463+0000 7fedc239c700 1 Processor -- start 2020-11-20T12:02:35.468 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.463+0000 7fedc239c700 1 -- start start 2020-11-20T12:02:35.475 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc239c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fedbc0bdfc0 0x7fedbc09e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.476 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc239c700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedbc1512d0 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.476 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc239c700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedbc151570 con 0x7fedbc09e560 2020-11-20T12:02:35.476 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc239c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedbc151810 con 0x7fedbc0bdfc0 2020-11-20T12:02:35.477 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc0b99700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fedbc0bdfc0 0x7fedbc09e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.477 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc139a700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fedbc0bdbe0 0x7fedbc09ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56302/0 (socket says 172.21.15.164:56302) 2020-11-20T12:02:35.477 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc139a700 1 -- 172.21.15.164:0/151842914 learned_addr learned my addr 172.21.15.164:0/151842914 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:35.477 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc0b99700 1 -- 172.21.15.164:0/151842914 >> v1:172.21.15.188:6789/0 conn(0x7fedbc09e560 legacy=0x7fedbc150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:35.478 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc0b99700 1 -- 172.21.15.164:0/151842914 >> v1:172.21.15.164:6789/0 conn(0x7fedbc0bdbe0 legacy=0x7fedbc09ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.478 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc0b99700 1 -- 172.21.15.164:0/151842914 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc151ab0 con 0x7fedbc0bdfc0 2020-11-20T12:02:35.478 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.464+0000 7fedc0b99700 1 --2- 172.21.15.164:0/151842914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdfc0 0x7fedbc09e070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fedac006fd0 tx=0x7fedac006e30).ready entity=mon.1 client_cookie=148927a11eed2e41 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:35.478 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.465+0000 7fedabfff700 1 -- 172.21.15.164:0/151842914 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0097a0 con 0x7fedbc0bdfc0 2020-11-20T12:02:35.478 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.465+0000 7fedabfff700 1 -- 172.21.15.164:0/151842914 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac000e90 con 0x7fedbc0bdfc0 2020-11-20T12:02:35.479 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.465+0000 7fedabfff700 1 -- 172.21.15.164:0/151842914 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac009b10 con 0x7fedbc0bdfc0 2020-11-20T12:02:35.479 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.465+0000 7fedc239c700 1 -- 172.21.15.164:0/151842914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdfc0 msgr2=0x7fedbc09e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.479 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.465+0000 7fedc239c700 1 --2- 172.21.15.164:0/151842914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdfc0 0x7fedbc09e070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fedac006fd0 tx=0x7fedac006e30).stop 2020-11-20T12:02:35.479 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.465+0000 7fedc239c700 1 -- 172.21.15.164:0/151842914 shutdown_connections 2020-11-20T12:02:35.479 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.465+0000 7fedc239c700 1 --2- 172.21.15.164:0/151842914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdfc0 0x7fedbc09e070 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.480 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.465+0000 7fedc239c700 1 -- 172.21.15.164:0/151842914 >> 172.21.15.164:0/151842914 conn(0x7fedbc07ffb0 msgr2=0x7fedbc0803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:35.480 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.465+0000 7fedc239c700 1 -- 172.21.15.164:0/151842914 shutdown_connections 2020-11-20T12:02:35.480 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.465+0000 7fedc239c700 1 -- 172.21.15.164:0/151842914 wait complete. 2020-11-20T12:02:35.480 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.466+0000 7fedc239c700 1 Processor -- start 2020-11-20T12:02:35.480 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.466+0000 7fedc239c700 1 -- start start 2020-11-20T12:02:35.481 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc239c700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedbc09e560 0x7fedbc157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.481 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc239c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdbe0 0x7fedbc156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.481 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc239c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedbc0bdfc0 0x7fedbc160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.481 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc239c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc1557d0 con 0x7fedbc0bdfc0 2020-11-20T12:02:35.481 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc239c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc157c00 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc239c700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc160c50 con 0x7fedbc09e560 2020-11-20T12:02:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc0b99700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdbe0 0x7fedbc156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc0b99700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdbe0 0x7fedbc156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46570/0 (socket says 172.21.15.164:46570) 2020-11-20T12:02:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc0b99700 1 -- 172.21.15.164:0/334051441 learned_addr learned my addr 172.21.15.164:0/334051441 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc139a700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedbc09e560 0x7fedbc157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.483 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.467+0000 7fedc1b9b700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedbc0bdfc0 0x7fedbc160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.483 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7fedc0b99700 1 -- 172.21.15.164:0/334051441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedbc09e560 msgr2=0x7fedbc157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.483 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7fedc0b99700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedbc09e560 0x7fedbc157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.483 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7fedc0b99700 1 -- 172.21.15.164:0/334051441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedbc0bdfc0 msgr2=0x7fedbc160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.483 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7fedc0b99700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedbc0bdfc0 0x7fedbc160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.484 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7fedc0b99700 1 -- 172.21.15.164:0/334051441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc160ef0 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.484 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7fedc0b99700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdbe0 0x7fedbc156140 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fedac009340 tx=0x7fedac015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:35.484 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7feda97fa700 1 -- 172.21.15.164:0/334051441 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac011d70 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.484 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7feda97fa700 1 -- 172.21.15.164:0/334051441 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac01e460 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.484 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7fedc239c700 1 -- 172.21.15.164:0/334051441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedbc161190 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.485 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7feda97fa700 1 -- 172.21.15.164:0/334051441 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac01e7e0 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.485 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.468+0000 7fedc239c700 1 -- 172.21.15.164:0/334051441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedbc155ca0 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.485 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.469+0000 7fedc239c700 1 -- 172.21.15.164:0/334051441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedbc05cf90 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.485 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.469+0000 7feda97fa700 1 -- 172.21.15.164:0/334051441 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fedac025030 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.485 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.470+0000 7feda97fa700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fed940806a0 0x7fed94082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:35.486 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.470+0000 7feda97fa700 1 -- 172.21.15.164:0/334051441 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fedac0a3fa0 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.486 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.470+0000 7fedc139a700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fed940806a0 0x7fed94082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:35.486 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.470+0000 7fedc139a700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fed940806a0 0x7fed94082b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fedb8007fd0 tx=0x7fedb8009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:35.487 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.473+0000 7feda97fa700 1 -- 172.21.15.164:0/334051441 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fedac0789b0 con 0x7fedbc0bdbe0 2020-11-20T12:02:35.616 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.612+0000 7fedc239c700 1 -- 172.21.15.164:0/334051441 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fedbc044fa0 con 0x7fed940806a0 2020-11-20T12:02:35.625 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.617+0000 7feda97fa700 1 -- 172.21.15.164:0/334051441 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151023 (secure 0 0 0) 0x7fedbc044fa0 con 0x7fed940806a0 2020-11-20T12:02:35.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.619+0000 7fedc239c700 1 -- 172.21.15.164:0/334051441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fed940806a0 msgr2=0x7fed94082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.626 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.619+0000 7fedc239c700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fed940806a0 0x7fed94082b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fedb8007fd0 tx=0x7fedb8009040).stop 2020-11-20T12:02:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.619+0000 7fedc239c700 1 -- 172.21.15.164:0/334051441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdbe0 msgr2=0x7fedbc156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.619+0000 7fedc239c700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdbe0 0x7fedbc156140 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fedac009340 tx=0x7fedac015000).stop 2020-11-20T12:02:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.620+0000 7fedc239c700 1 -- 172.21.15.164:0/334051441 shutdown_connections 2020-11-20T12:02:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.620+0000 7fedc239c700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fed940806a0 0x7fed94082b60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.620+0000 7fedc239c700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedbc0bdfc0 0x7fedbc160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.620+0000 7fedc239c700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedbc09e560 0x7fedbc157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.620+0000 7fedc239c700 1 --2- 172.21.15.164:0/334051441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedbc0bdbe0 0x7fedbc156140 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.620+0000 7fedc239c700 1 -- 172.21.15.164:0/334051441 >> 172.21.15.164:0/334051441 conn(0x7fedbc07ffb0 msgr2=0x7fedbc0619f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.620+0000 7fedc239c700 1 -- 172.21.15.164:0/334051441 shutdown_connections 2020-11-20T12:02:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:35.620+0000 7fedc239c700 1 -- 172.21.15.164:0/334051441 wait complete. 2020-11-20T12:02:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2020-11-20T12:02:35.631 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T12:02:35.636 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2020-11-20T12:02:34.307188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384264,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":68039,"num_read_kb":4839627,"num_write":247435,"num_write_kb":25840763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80625,"ondisk_log_size":80625,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3534216,"kb_used_data":4264,"kb_used_omap":0,"kb_used_meta":3529856,"kb_avail":1128927864,"statfs":{"total":1159641169920,"available":1156022132736,"internally_reserved":0,"allocated":4366336,"data_stored":2400180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3614572544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4269,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002508"},"pg_stats":[{"pgid":"4.2","version":"28'28576","reported_seq":"36765","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.351466+0000","last_change":"2020-11-20T11:50:39.389929+0000","last_active":"2020-11-20T12:02:11.351466+0000","last_peered":"2020-11-20T12:02:11.351466+0000","last_clean":"2020-11-20T12:02:11.351466+0000","last_became_active":"2020-11-20T11:50:39.389230+0000","last_became_peered":"2020-11-20T11:50:39.389230+0000","last_unstale":"2020-11-20T12:02:11.351466+0000","last_undegraded":"2020-11-20T12:02:11.351466+0000","last_fullsized":"2020-11-20T12:02:11.351466+0000","mapping_epoch":26,"log_start":"28'18500","ondisk_log_start":"28'18500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10076,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8178,"num_read_kb":581860,"num_write":29951,"num_write_kb":3122376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,0],"acting":[9,10,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.313704+0000","last_change":"2020-11-20T11:50:33.149836+0000","last_active":"2020-11-20T11:50:39.313704+0000","last_peered":"2020-11-20T11:50:39.313704+0000","last_clean":"2020-11-20T11:50:39.313704+0000","last_became_active":"2020-11-20T11:50:33.149402+0000","last_became_peered":"2020-11-20T11:50:33.149402+0000","last_unstale":"2020-11-20T11:50:39.313704+0000","last_undegraded":"2020-11-20T11:50:39.313704+0000","last_fullsized":"2020-11-20T11:50:39.313704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'10","reported_seq":"22","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.431814+0000","last_change":"2020-11-20T11:50:36.273858+0000","last_active":"2020-11-20T12:02:11.431814+0000","last_peered":"2020-11-20T12:02:11.431814+0000","last_clean":"2020-11-20T12:02:11.431814+0000","last_became_active":"2020-11-20T11:50:36.273570+0000","last_became_peered":"2020-11-20T11:50:36.273570+0000","last_unstale":"2020-11-20T12:02:11.431814+0000","last_undegraded":"2020-11-20T12:02:11.431814+0000","last_fullsized":"2020-11-20T12:02:11.431814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"28'30631","reported_seq":"39450","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.325393+0000","last_change":"2020-11-20T11:50:39.280178+0000","last_active":"2020-11-20T12:02:11.325393+0000","last_peered":"2020-11-20T12:02:11.325393+0000","last_clean":"2020-11-20T12:02:11.325393+0000","last_became_active":"2020-11-20T11:50:39.279495+0000","last_became_peered":"2020-11-20T11:50:39.279495+0000","last_unstale":"2020-11-20T12:02:11.325393+0000","last_undegraded":"2020-11-20T12:02:11.325393+0000","last_fullsized":"2020-11-20T12:02:11.325393+0000","mapping_epoch":26,"log_start":"28'20602","ondisk_log_start":"28'20602","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10029,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8808,"num_read_kb":624576,"num_write":32062,"num_write_kb":3350923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,6],"acting":[8,2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270526+0000","last_change":"2020-11-20T11:50:33.144081+0000","last_active":"2020-11-20T11:50:39.270526+0000","last_peered":"2020-11-20T11:50:39.270526+0000","last_clean":"2020-11-20T11:50:39.270526+0000","last_became_active":"2020-11-20T11:50:33.143591+0000","last_became_peered":"2020-11-20T11:50:33.143591+0000","last_unstale":"2020-11-20T11:50:39.270526+0000","last_undegraded":"2020-11-20T11:50:39.270526+0000","last_fullsized":"2020-11-20T11:50:39.270526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.630243+0000","last_change":"2020-11-20T11:50:36.456248+0000","last_active":"2020-11-20T11:50:39.630243+0000","last_peered":"2020-11-20T11:50:39.630243+0000","last_clean":"2020-11-20T11:50:39.630243+0000","last_became_active":"2020-11-20T11:50:36.455930+0000","last_became_peered":"2020-11-20T11:50:36.455930+0000","last_unstale":"2020-11-20T11:50:39.630243+0000","last_undegraded":"2020-11-20T11:50:39.630243+0000","last_fullsized":"2020-11-20T11:50:39.630243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"28'26515","reported_seq":"34215","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.401155+0000","last_change":"2020-11-20T11:50:39.278909+0000","last_active":"2020-11-20T12:02:11.401155+0000","last_peered":"2020-11-20T12:02:11.401155+0000","last_clean":"2020-11-20T12:02:11.401155+0000","last_became_active":"2020-11-20T11:50:39.278305+0000","last_became_peered":"2020-11-20T11:50:39.278305+0000","last_unstale":"2020-11-20T12:02:11.401155+0000","last_undegraded":"2020-11-20T12:02:11.401155+0000","last_fullsized":"2020-11-20T12:02:11.401155+0000","mapping_epoch":26,"log_start":"28'16500","ondisk_log_start":"28'16500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10015,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7689,"num_read_kb":545912,"num_write":27745,"num_write_kb":2901671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,8,9],"acting":[2,0,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.273540+0000","last_change":"2020-11-20T11:50:33.149828+0000","last_active":"2020-11-20T11:50:39.273540+0000","last_peered":"2020-11-20T11:50:39.273540+0000","last_clean":"2020-11-20T11:50:39.273540+0000","last_became_active":"2020-11-20T11:50:33.149428+0000","last_became_peered":"2020-11-20T11:50:33.149428+0000","last_unstale":"2020-11-20T11:50:39.273540+0000","last_undegraded":"2020-11-20T11:50:39.273540+0000","last_fullsized":"2020-11-20T11:50:39.273540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'9","reported_seq":"21","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.629215+0000","last_change":"2020-11-20T11:50:37.249871+0000","last_active":"2020-11-20T11:50:39.629215+0000","last_peered":"2020-11-20T11:50:39.629215+0000","last_clean":"2020-11-20T11:50:39.629215+0000","last_became_active":"2020-11-20T11:50:37.249478+0000","last_became_peered":"2020-11-20T11:50:37.249478+0000","last_unstale":"2020-11-20T11:50:39.629215+0000","last_undegraded":"2020-11-20T11:50:39.629215+0000","last_fullsized":"2020-11-20T11:50:39.629215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"28'29200","reported_seq":"37743","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.374603+0000","last_change":"2020-11-20T11:50:39.315989+0000","last_active":"2020-11-20T12:02:11.374603+0000","last_peered":"2020-11-20T12:02:11.374603+0000","last_clean":"2020-11-20T12:02:11.374603+0000","last_became_active":"2020-11-20T11:50:39.315322+0000","last_became_peered":"2020-11-20T11:50:39.315322+0000","last_unstale":"2020-11-20T12:02:11.374603+0000","last_undegraded":"2020-11-20T12:02:11.374603+0000","last_fullsized":"2020-11-20T12:02:11.374603+0000","mapping_epoch":26,"log_start":"28'19100","ondisk_log_start":"28'19100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10100,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8532,"num_read_kb":608812,"num_write":30604,"num_write_kb":3202634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1,3],"acting":[7,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.312978+0000","last_change":"2020-11-20T11:50:33.453134+0000","last_active":"2020-11-20T11:50:39.312978+0000","last_peered":"2020-11-20T11:50:39.312978+0000","last_clean":"2020-11-20T11:50:39.312978+0000","last_became_active":"2020-11-20T11:50:33.452821+0000","last_became_peered":"2020-11-20T11:50:33.452821+0000","last_unstale":"2020-11-20T11:50:39.312978+0000","last_undegraded":"2020-11-20T11:50:39.312978+0000","last_fullsized":"2020-11-20T11:50:39.312978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270532+0000","last_change":"2020-11-20T11:50:28.351977+0000","last_active":"2020-11-20T11:50:39.270532+0000","last_peered":"2020-11-20T11:50:39.270532+0000","last_clean":"2020-11-20T11:50:39.270532+0000","last_became_active":"2020-11-20T11:50:28.351248+0000","last_became_peered":"2020-11-20T11:50:28.351248+0000","last_unstale":"2020-11-20T11:50:39.270532+0000","last_undegraded":"2020-11-20T11:50:39.270532+0000","last_fullsized":"2020-11-20T11:50:39.270532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:22.155217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:22.155217+0000","last_clean_scrub_stamp":"2020-11-20T11:50:22.155217+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"13","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.621397+0000","last_change":"2020-11-20T11:50:36.274590+0000","last_active":"2020-11-20T11:50:39.621397+0000","last_peered":"2020-11-20T11:50:39.621397+0000","last_clean":"2020-11-20T11:50:39.621397+0000","last_became_active":"2020-11-20T11:50:36.274158+0000","last_became_peered":"2020-11-20T11:50:36.274158+0000","last_unstale":"2020-11-20T11:50:39.621397+0000","last_undegraded":"2020-11-20T11:50:39.621397+0000","last_fullsized":"2020-11-20T11:50:39.621397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"28'31861","reported_seq":"41154","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.362913+0000","last_change":"2020-11-20T11:50:39.390204+0000","last_active":"2020-11-20T12:02:11.362913+0000","last_peered":"2020-11-20T12:02:11.362913+0000","last_clean":"2020-11-20T12:02:11.362913+0000","last_became_active":"2020-11-20T11:50:39.389493+0000","last_became_peered":"2020-11-20T11:50:39.389493+0000","last_unstale":"2020-11-20T12:02:11.362913+0000","last_undegraded":"2020-11-20T12:02:11.362913+0000","last_fullsized":"2020-11-20T12:02:11.362913+0000","mapping_epoch":26,"log_start":"28'21800","ondisk_log_start":"28'21800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10061,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9282,"num_read_kb":661352,"num_write":33383,"num_write_kb":3474570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2,10],"acting":[9,8,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.270533+0000","last_change":"2020-11-20T11:50:33.144765+0000","last_active":"2020-11-20T11:50:39.270533+0000","last_peered":"2020-11-20T11:50:39.270533+0000","last_clean":"2020-11-20T11:50:39.270533+0000","last_became_active":"2020-11-20T11:50:33.144316+0000","last_became_peered":"2020-11-20T11:50:33.144316+0000","last_unstale":"2020-11-20T11:50:39.270533+0000","last_undegraded":"2020-11-20T11:50:39.270533+0000","last_fullsized":"2020-11-20T11:50:39.270533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'4","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:20.802188+0000","last_change":"2020-11-20T11:50:36.456553+0000","last_active":"2020-11-20T12:02:20.802188+0000","last_peered":"2020-11-20T12:02:20.802188+0000","last_clean":"2020-11-20T12:02:20.802188+0000","last_became_active":"2020-11-20T11:50:36.456244+0000","last_became_peered":"2020-11-20T11:50:36.456244+0000","last_unstale":"2020-11-20T12:02:20.802188+0000","last_undegraded":"2020-11-20T12:02:20.802188+0000","last_fullsized":"2020-11-20T12:02:20.802188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2121,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":3,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"28'28831","reported_seq":"37235","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.254780+0000","last_change":"2020-11-20T11:50:39.316003+0000","last_active":"2020-11-20T12:02:11.254780+0000","last_peered":"2020-11-20T12:02:11.254780+0000","last_clean":"2020-11-20T12:02:11.254780+0000","last_became_active":"2020-11-20T11:50:39.315185+0000","last_became_peered":"2020-11-20T11:50:39.315185+0000","last_unstale":"2020-11-20T12:02:11.254780+0000","last_undegraded":"2020-11-20T12:02:11.254780+0000","last_fullsized":"2020-11-20T12:02:11.254780+0000","mapping_epoch":26,"log_start":"28'18800","ondisk_log_start":"28'18800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10031,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8393,"num_read_kb":600024,"num_write":30168,"num_write_kb":3162593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,11],"acting":[0,2,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.313009+0000","last_change":"2020-11-20T11:50:33.146356+0000","last_active":"2020-11-20T11:50:39.313009+0000","last_peered":"2020-11-20T11:50:39.313009+0000","last_clean":"2020-11-20T11:50:39.313009+0000","last_became_active":"2020-11-20T11:50:33.146090+0000","last_became_peered":"2020-11-20T11:50:33.146090+0000","last_unstale":"2020-11-20T11:50:39.313009+0000","last_undegraded":"2020-11-20T11:50:39.313009+0000","last_fullsized":"2020-11-20T11:50:39.313009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'126","reported_seq":"138","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:20.598499+0000","last_change":"2020-11-20T11:50:36.274051+0000","last_active":"2020-11-20T12:02:20.598499+0000","last_peered":"2020-11-20T12:02:20.598499+0000","last_clean":"2020-11-20T12:02:20.598499+0000","last_became_active":"2020-11-20T11:50:36.273653+0000","last_became_peered":"2020-11-20T11:50:36.273653+0000","last_unstale":"2020-11-20T12:02:20.598499+0000","last_undegraded":"2020-11-20T12:02:20.598499+0000","last_fullsized":"2020-11-20T12:02:20.598499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":126,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":381374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"28'30345","reported_seq":"38993","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.358084+0000","last_change":"2020-11-20T11:50:39.390131+0000","last_active":"2020-11-20T12:02:11.358084+0000","last_peered":"2020-11-20T12:02:11.358084+0000","last_clean":"2020-11-20T12:02:11.358084+0000","last_became_active":"2020-11-20T11:50:39.389272+0000","last_became_peered":"2020-11-20T11:50:39.389272+0000","last_unstale":"2020-11-20T12:02:11.358084+0000","last_undegraded":"2020-11-20T12:02:11.358084+0000","last_fullsized":"2020-11-20T12:02:11.358084+0000","mapping_epoch":26,"log_start":"28'20300","ondisk_log_start":"28'20300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10045,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8637,"num_read_kb":612900,"num_write":31806,"num_write_kb":3327179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,11,7],"acting":[5,10,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'7","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:50:39.628793+0000","last_change":"2020-11-20T11:50:37.249008+0000","last_active":"2020-11-20T11:50:39.628793+0000","last_peered":"2020-11-20T11:50:39.628793+0000","last_clean":"2020-11-20T11:50:39.628793+0000","last_became_active":"2020-11-20T11:50:37.248661+0000","last_became_peered":"2020-11-20T11:50:37.248661+0000","last_unstale":"2020-11-20T11:50:39.628793+0000","last_undegraded":"2020-11-20T11:50:39.628793+0000","last_fullsized":"2020-11-20T11:50:39.628793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.271281+0000","last_change":"2020-11-20T11:50:33.395499+0000","last_active":"2020-11-20T11:50:39.271281+0000","last_peered":"2020-11-20T11:50:39.271281+0000","last_clean":"2020-11-20T11:50:39.271281+0000","last_became_active":"2020-11-20T11:50:33.395209+0000","last_became_peered":"2020-11-20T11:50:33.395209+0000","last_unstale":"2020-11-20T11:50:39.271281+0000","last_undegraded":"2020-11-20T11:50:39.271281+0000","last_fullsized":"2020-11-20T11:50:39.271281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"28'30089","reported_seq":"38618","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:11.304921+0000","last_change":"2020-11-20T11:50:39.315204+0000","last_active":"2020-11-20T12:02:11.304921+0000","last_peered":"2020-11-20T12:02:11.304921+0000","last_clean":"2020-11-20T12:02:11.304921+0000","last_became_active":"2020-11-20T11:50:39.314678+0000","last_became_peered":"2020-11-20T11:50:39.314678+0000","last_unstale":"2020-11-20T12:02:11.304921+0000","last_undegraded":"2020-11-20T12:02:11.304921+0000","last_fullsized":"2020-11-20T12:02:11.304921+0000","mapping_epoch":26,"log_start":"28'20000","ondisk_log_start":"28'20000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:38.264765+0000","last_clean_scrub_stamp":"2020-11-20T11:50:38.264765+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8518,"num_read_kb":604188,"num_write":31532,"num_write_kb":3298368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,7],"acting":[6,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:50:39.312979+0000","last_change":"2020-11-20T11:50:33.395626+0000","last_active":"2020-11-20T11:50:39.312979+0000","last_peered":"2020-11-20T11:50:39.312979+0000","last_clean":"2020-11-20T11:50:39.312979+0000","last_became_active":"2020-11-20T11:50:33.395281+0000","last_became_peered":"2020-11-20T11:50:33.395281+0000","last_unstale":"2020-11-20T11:50:39.312979+0000","last_undegraded":"2020-11-20T11:50:39.312979+0000","last_fullsized":"2020-11-20T11:50:39.312979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:32.131349+0000","last_clean_scrub_stamp":"2020-11-20T11:50:32.131349+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'13","reported_seq":"25","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:08.300881+0000","last_change":"2020-11-20T11:50:36.274786+0000","last_active":"2020-11-20T12:02:08.300881+0000","last_peered":"2020-11-20T12:02:08.300881+0000","last_clean":"2020-11-20T12:02:08.300881+0000","last_became_active":"2020-11-20T11:50:36.274438+0000","last_became_peered":"2020-11-20T11:50:36.274438+0000","last_unstale":"2020-11-20T12:02:08.300881+0000","last_undegraded":"2020-11-20T12:02:08.300881+0000","last_fullsized":"2020-11-20T12:02:08.300881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:50:35.250749+0000","last_clean_scrub_stamp":"2020-11-20T11:50:35.250749+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68037,"num_read_kb":4839624,"num_write":247251,"num_write_kb":25840314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80446,"ondisk_log_size":80446,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":384264,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":3,"num_write":181,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":768528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":176,"ondisk_log_size":176,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444179,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230124,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":229824,"kb_avail":94141716,"statfs":{"total":96636764160,"available":96401117184,"internally_reserved":0,"allocated":299008,"data_stored":138092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":235339776},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":2.427,"15min":1.909},"min":{"1min":0.628,"5min":0.57399999999999995,"15min":0.56799999999999995},"max":{"1min":6.5979999999999999,"5min":45.957000000000001,"15min":56.518000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":2.238,"5min":2.5720000000000001,"15min":1.988},"min":{"1min":0.67200000000000004,"5min":0.59199999999999997,"15min":0.56399999999999995},"max":{"1min":6.6349999999999998,"5min":46.25,"15min":57.197000000000003},"last":1.2130000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":7.173,"5min":6.7859999999999996,"15min":3.2650000000000001},"min":{"1min":0.66300000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":24.568000000000001,"5min":44.758000000000003,"15min":44.758000000000003},"last":0.91500000000000004},{"interface":"front","average":{"1min":6.234,"5min":6.258,"15min":3.0539999999999998},"min":{"1min":0.81899999999999995,"5min":0.64000000000000001,"15min":0.624},"max":{"1min":23.788,"5min":44.119,"15min":44.119},"last":0.98299999999999998}]},{"osd":3,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.9870000000000001,"15min":1.669},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":4.3470000000000004,"5min":39.085000000000001,"15min":39.085000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.7110000000000001,"5min":2.5259999999999998,"15min":1.952},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":7.8300000000000001,"5min":39.098999999999997,"15min":39.098999999999997},"last":1.288}]},{"osd":4,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":2.7040000000000002,"15min":1.921},"min":{"1min":0.76500000000000001,"5min":0.69699999999999995,"15min":0.63400000000000001},"max":{"1min":7.3010000000000002,"5min":64.099000000000004,"15min":64.099000000000004},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":2.3170000000000002,"15min":1.74},"min":{"1min":0.75900000000000001,"5min":0.69699999999999995,"15min":0.58899999999999997},"max":{"1min":3.4609999999999999,"5min":64.334999999999994,"15min":64.334999999999994},"last":1.2649999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":2.9159999999999999,"15min":2.105},"min":{"1min":0.79400000000000004,"5min":0.747,"15min":0.66100000000000003},"max":{"1min":8.2919999999999998,"5min":34.286999999999999,"15min":34.286999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":2.3319999999999999,"5min":3.3719999999999999,"15min":2.3879999999999999},"min":{"1min":1.0489999999999999,"5min":0.86499999999999999,"15min":0.80000000000000004},"max":{"1min":7.6479999999999997,"5min":34.472999999999999,"15min":34.472999999999999},"last":1.3440000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":3.0939999999999999,"5min":3.2530000000000001,"15min":2.5430000000000001},"min":{"1min":0.94199999999999995,"5min":0.621,"15min":0.621},"max":{"1min":18.669,"5min":46.186,"15min":58.046999999999997},"last":1.1699999999999999},{"interface":"front","average":{"1min":3.2240000000000002,"5min":3.7789999999999999,"15min":2.8260000000000001},"min":{"1min":1.056,"5min":1.028,"15min":0.91900000000000004},"max":{"1min":19.599,"5min":46.640000000000001,"15min":57.896000000000001},"last":1.5349999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":7.1150000000000002,"5min":5.3940000000000001,"15min":3.0710000000000002},"min":{"1min":1.2310000000000001,"5min":1.044,"15min":0.91600000000000004},"max":{"1min":29.625,"5min":65.272999999999996,"15min":65.272999999999996},"last":1.6719999999999999},{"interface":"front","average":{"1min":6.5970000000000004,"5min":5.1699999999999999,"15min":2.9790000000000001},"min":{"1min":1.008,"5min":0.871,"15min":0.871},"max":{"1min":29.451000000000001,"5min":64.081000000000003,"15min":64.081000000000003},"last":1.607}]},{"osd":8,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":8.2699999999999996,"5min":6.4809999999999999,"15min":3.536},"min":{"1min":1.292,"5min":1.1200000000000001,"15min":1.006},"max":{"1min":45.953000000000003,"5min":45.953000000000003,"15min":45.953000000000003},"last":1.712},{"interface":"front","average":{"1min":8.2309999999999999,"5min":6.2210000000000001,"15min":3.419},"min":{"1min":1.175,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":46.667000000000002,"5min":46.667000000000002,"15min":46.667000000000002},"last":1.5820000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:02:03 2020","interfaces":[{"interface":"back","average":{"1min":2.246,"5min":3.2730000000000001,"15min":2.6920000000000002},"min":{"1min":1.23,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":8.2929999999999993,"5min":47.347999999999999,"15min":58.792000000000002},"last":1.51},{"interface":"front","average":{"1min":2.4100000000000001,"5min":3.6859999999999999,"15min":2.9729999999999999},"min":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"max":{"1min":8.0649999999999995,"5min":46.463000000000001,"15min":58.162999999999997},"last":1.6240000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":3.0110000000000001,"5min":4.4530000000000003,"15min":2.9399999999999999},"min":{"1min":1.1859999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"max":{"1min":15.298,"5min":65.462000000000003,"15min":65.462000000000003},"last":1.7929999999999999},{"interface":"front","average":{"1min":3.137,"5min":4.2889999999999997,"15min":2.843},"min":{"1min":1.2729999999999999,"5min":1.143,"15min":1.143},"max":{"1min":15.246,"5min":64.566999999999993,"15min":64.566999999999993},"last":1.7609999999999999}]}]},{"osd":10,"up_from":17,"seq":73014444180,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341748,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":341440,"kb_avail":94030092,"statfs":{"total":96636764160,"available":96286814208,"internally_reserved":0,"allocated":307200,"data_stored":136165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":349634560},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":1,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":4.2489999999999997,"5min":2.7370000000000001,"15min":1.7250000000000001},"min":{"1min":0.68000000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":36.079999999999998,"5min":36.079999999999998,"15min":36.079999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":4.7220000000000004,"5min":3.391,"15min":2.02},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":36.460000000000001,"5min":37.271999999999998,"15min":37.271999999999998},"last":0.93300000000000005}]},{"osd":2,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":18.879000000000001,"5min":10.077999999999999,"15min":4.2530000000000001},"min":{"1min":0.76400000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":58.145000000000003,"5min":58.145000000000003,"15min":58.145000000000003},"last":1.1819999999999999},{"interface":"front","average":{"1min":17.375,"5min":10.433999999999999,"15min":4.6440000000000001},"min":{"1min":0.95799999999999996,"5min":0.78000000000000003,"15min":0.64600000000000002},"max":{"1min":58.229999999999997,"5min":58.229999999999997,"15min":58.229999999999997},"last":1.5029999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":6.0990000000000002,"5min":4.4489999999999998,"15min":2.472},"min":{"1min":0.747,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":35.633000000000003,"5min":37.094000000000001,"15min":37.094000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":5.726,"5min":4.5910000000000002,"15min":2.6440000000000001},"min":{"1min":0.85699999999999998,"5min":0.753,"15min":0.753},"max":{"1min":35.667000000000002,"5min":35.667000000000002,"15min":35.667000000000002},"last":1.3819999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":4.2649999999999997,"5min":6.8730000000000002,"15min":3.3450000000000002},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":36.332000000000001,"5min":256.52499999999998,"15min":256.52499999999998},"last":1.242},{"interface":"front","average":{"1min":4.673,"5min":7.4020000000000001,"15min":3.5030000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":35.771000000000001,"5min":259.17500000000001,"15min":259.17500000000001},"last":1.276}]},{"osd":5,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":5.6980000000000004,"5min":5.7839999999999998,"15min":3.1659999999999999},"min":{"1min":0.79900000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":36.603000000000002,"5min":37.502000000000002,"15min":37.502000000000002},"last":1.4610000000000001},{"interface":"front","average":{"1min":7.4130000000000003,"5min":5.242,"15min":3.0289999999999999},"min":{"1min":0.91400000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":36.499000000000002,"5min":37.375999999999998,"15min":37.375999999999998},"last":1.417}]},{"osd":6,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":10.222,"5min":6.2229999999999999,"15min":3.5289999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.78100000000000003},"max":{"1min":64.608999999999995,"5min":64.608999999999995,"15min":64.608999999999995},"last":1.613},{"interface":"front","average":{"1min":6.9640000000000004,"5min":6.4390000000000001,"15min":3.5670000000000002},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":36.845999999999997,"5min":39.478000000000002,"15min":39.478000000000002},"last":1.7689999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":13.191000000000001,"5min":9.6660000000000004,"15min":4.5359999999999996},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0069999999999999},"max":{"1min":64.647999999999996,"5min":64.647999999999996,"15min":64.647999999999996},"last":1.55},{"interface":"front","average":{"1min":15.058999999999999,"5min":8.9890000000000008,"15min":4.3360000000000003},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":64.965000000000003,"5min":64.965000000000003,"15min":64.965000000000003},"last":1.7210000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:02:00 2020","interfaces":[{"interface":"back","average":{"1min":14.737,"5min":12.978999999999999,"15min":5.8140000000000001},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":64.879000000000005,"5min":64.879000000000005,"15min":64.879000000000005},"last":1.8129999999999999},{"interface":"front","average":{"1min":13.103999999999999,"5min":11.922000000000001,"15min":5.383},"min":{"1min":1.0700000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":65.153999999999996,"5min":65.153999999999996,"15min":65.153999999999996},"last":1.577}]},{"osd":9,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":9.218,"5min":7.0190000000000001,"15min":3.9079999999999999},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":64.762,"5min":64.762,"15min":64.762},"last":1.8919999999999999},{"interface":"front","average":{"1min":8.3089999999999993,"5min":7.6369999999999996,"15min":4.0359999999999996},"min":{"1min":1.135,"5min":1.1020000000000001,"15min":1.079},"max":{"1min":40.060000000000002,"5min":44.075000000000003,"15min":44.075000000000003},"last":1.681}]},{"osd":11,"last update":"Fri Nov 20 12:01:49 2020","interfaces":[{"interface":"back","average":{"1min":6.8700000000000001,"5min":6.2960000000000003,"15min":3.472},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":36.637,"5min":37.585000000000001,"15min":37.585000000000001},"last":1.641},{"interface":"front","average":{"1min":7.593,"5min":6.0090000000000003,"15min":3.5579999999999998},"min":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"max":{"1min":35.936999999999998,"5min":35.936999999999998,"15min":35.936999999999998},"last":1.966}]}]},{"osd":9,"up_from":17,"seq":73014444178,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321000,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":320704,"kb_avail":94050840,"statfs":{"total":96636764160,"available":96308060160,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":328400896},"hb_peers":[0,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":4.2720000000000002,"5min":2.3250000000000002,"15min":1.8859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":25.289000000000001,"5min":25.289000000000001,"15min":25.289000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":6.9429999999999996,"5min":3.5339999999999998,"15min":2.589},"min":{"1min":0.89100000000000001,"5min":0.63300000000000001,"15min":0.55100000000000005},"max":{"1min":47.780000000000001,"5min":47.780000000000001,"15min":60.811999999999998},"last":1.101}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":10.868,"5min":7.7210000000000001,"15min":3.98},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.65400000000000003},"max":{"1min":25.381,"5min":45.261000000000003,"15min":58.615000000000002},"last":1.3580000000000001},{"interface":"front","average":{"1min":10.151999999999999,"5min":7.1520000000000001,"15min":3.8759999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.68100000000000005},"max":{"1min":28.829999999999998,"5min":44.813000000000002,"15min":60.926000000000002},"last":1.425}]},{"osd":3,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.726,"5min":2.665,"15min":2.258},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66200000000000003},"max":{"1min":20.359000000000002,"5min":20.359000000000002,"15min":58.482999999999997},"last":1.468},{"interface":"front","average":{"1min":2.056,"5min":2.609,"15min":2.1179999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.61299999999999999},"max":{"1min":18.207999999999998,"5min":18.207999999999998,"15min":58.448999999999998},"last":1.145}]},{"osd":4,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":3.528,"15min":2.77},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":20.119,"5min":111.11,"15min":111.11},"last":1.839},{"interface":"front","average":{"1min":2.8180000000000001,"5min":3.9449999999999998,"15min":2.863},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":20.468,"5min":111.654,"15min":111.654},"last":1.869}]},{"osd":5,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":2.7829999999999999,"15min":2.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.64000000000000001},"max":{"1min":18.385000000000002,"5min":18.385000000000002,"15min":58.762999999999998},"last":1.2410000000000001},{"interface":"front","average":{"1min":2.899,"5min":2.9100000000000001,"15min":2.7120000000000002},"min":{"1min":0.86299999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":20.399000000000001,"5min":20.399000000000001,"15min":61.164999999999999},"last":2.4729999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:02:03 2020","interfaces":[{"interface":"back","average":{"1min":4.4660000000000002,"5min":3.46,"15min":2.7829999999999999},"min":{"1min":0.98799999999999999,"5min":0.749,"15min":0.749},"max":{"1min":24.835999999999999,"5min":24.835999999999999,"15min":60.853999999999999},"last":1.401},{"interface":"front","average":{"1min":4.5389999999999997,"5min":3.5139999999999998,"15min":3.1139999999999999},"min":{"1min":1.1080000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":25.173999999999999,"5min":25.173999999999999,"15min":61.052999999999997},"last":2.1499999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":6.5060000000000002,"5min":5.8630000000000004,"15min":3.7029999999999998},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":50.103999999999999,"5min":50.103999999999999,"15min":62.203000000000003},"last":2.0449999999999999},{"interface":"front","average":{"1min":6.258,"5min":5.734,"15min":3.5539999999999998},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93500000000000005},"max":{"1min":51.006,"5min":51.006,"15min":63.213999999999999},"last":1.496}]},{"osd":8,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":7.8310000000000004,"5min":6.0720000000000001,"15min":3.8439999999999999},"min":{"1min":1.099,"5min":1.099,"15min":1.0669999999999999},"max":{"1min":25.058,"5min":28.248999999999999,"15min":61.280999999999999},"last":2.335},{"interface":"front","average":{"1min":8.9629999999999992,"5min":7.4020000000000001,"15min":4.2670000000000003},"min":{"1min":1.4630000000000001,"5min":1.3280000000000001,"15min":1.1020000000000001},"max":{"1min":26.751000000000001,"5min":29.207999999999998,"15min":62.451000000000001},"last":2.1269999999999998}]},{"osd":10,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":3.2829999999999999,"5min":4.7089999999999996,"15min":3.2999999999999998},"min":{"1min":1.2030000000000001,"5min":1.087,"15min":0.89300000000000002},"max":{"1min":18.513000000000002,"5min":34.356000000000002,"15min":62.869999999999997},"last":1.923},{"interface":"front","average":{"1min":3.4060000000000001,"5min":4.1550000000000002,"15min":3.335},"min":{"1min":1.292,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":20.628,"5min":24.483000000000001,"15min":61.386000000000003},"last":2.633}]},{"osd":11,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":3.1349999999999998,"5min":3.3969999999999998,"15min":2.9620000000000002},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":20.959,"5min":20.959,"15min":62.335000000000001},"last":2.2440000000000002},{"interface":"front","average":{"1min":2.6659999999999999,"5min":3.4350000000000001,"15min":2.9740000000000002},"min":{"1min":1.286,"5min":1.286,"15min":1.085},"max":{"1min":18.706,"5min":18.706,"15min":63.060000000000002},"last":2.214}]}]},{"osd":8,"up_from":17,"seq":73014444179,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":332396,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":331712,"kb_avail":94039444,"statfs":{"total":96636764160,"available":96296390656,"internally_reserved":0,"allocated":692224,"data_stored":517505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339673088},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":6.3129999999999997,"5min":4.6769999999999996,"15min":2.5870000000000002},"min":{"1min":0.66400000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":31.827999999999999,"5min":39.372999999999998,"15min":39.372999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":7.1630000000000003,"5min":4.9470000000000001,"15min":2.6859999999999999},"min":{"1min":0.66900000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":31.295999999999999,"5min":39.444000000000003,"15min":39.444000000000003},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":20.245999999999999,"5min":15.07,"15min":5.9969999999999999},"min":{"1min":0.71999999999999997,"5min":0.64300000000000002,"15min":0.60999999999999999},"max":{"1min":59.988999999999997,"5min":59.988999999999997,"15min":59.988999999999997},"last":0.73099999999999998},{"interface":"front","average":{"1min":25.106999999999999,"5min":16.727,"15min":6.6269999999999998},"min":{"1min":0.73899999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":60.848999999999997,"5min":60.848999999999997,"15min":60.848999999999997},"last":0.98799999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":7.9480000000000004,"5min":4.6710000000000003,"15min":2.536},"min":{"1min":0.82699999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":30.893999999999998,"5min":30.893999999999998,"15min":30.893999999999998},"last":0.755},{"interface":"front","average":{"1min":10.818,"5min":6.4269999999999996,"15min":3.3100000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":38.066000000000003,"5min":39.195999999999998,"15min":39.195999999999998},"last":1.0429999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":8.6679999999999993,"5min":7.3310000000000004,"15min":3.5739999999999998},"min":{"1min":0.878,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":37.820999999999998,"5min":166.27000000000001,"15min":166.27000000000001},"last":1.383},{"interface":"front","average":{"1min":11.459,"5min":8.6639999999999997,"15min":3.9860000000000002},"min":{"1min":0.79300000000000004,"5min":0.66000000000000003,"15min":0.65700000000000003},"max":{"1min":37.433999999999997,"5min":165.77600000000001,"15min":165.77600000000001},"last":1.224}]},{"osd":5,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":14.531000000000001,"5min":8.3179999999999996,"15min":3.8809999999999998},"min":{"1min":0.68000000000000005,"5min":0.64200000000000002,"15min":0.621},"max":{"1min":37.692999999999998,"5min":38.509999999999998,"15min":38.509999999999998},"last":0.79000000000000004},{"interface":"front","average":{"1min":10.944000000000001,"5min":6.6020000000000003,"15min":3.27},"min":{"1min":1.0149999999999999,"5min":0.873,"15min":0.69899999999999995},"max":{"1min":31.050000000000001,"5min":39.585999999999999,"15min":39.585999999999999},"last":1.268}]},{"osd":6,"last update":"Fri Nov 20 12:02:00 2020","interfaces":[{"interface":"back","average":{"1min":8.7390000000000008,"5min":7.7430000000000003,"15min":3.9510000000000001},"min":{"1min":1.1140000000000001,"5min":0.90500000000000003,"15min":0.73299999999999998},"max":{"1min":31.332999999999998,"5min":39.640999999999998,"15min":39.640999999999998},"last":1.5069999999999999},{"interface":"front","average":{"1min":10.705,"5min":9.7119999999999997,"15min":4.5739999999999998},"min":{"1min":0.98199999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":31.352,"5min":39.607999999999997,"15min":39.607999999999997},"last":1.137}]},{"osd":7,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":17.698,"5min":11.929,"15min":5.2599999999999998},"min":{"1min":1.0680000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":37.591999999999999,"5min":51.020000000000003,"15min":51.020000000000003},"last":1.5900000000000001},{"interface":"front","average":{"1min":19.245999999999999,"5min":13.065,"15min":5.7999999999999998},"min":{"1min":1.8009999999999999,"5min":1.2729999999999999,"15min":1.216},"max":{"1min":39.064999999999998,"5min":40.451000000000001,"15min":40.451000000000001},"last":1.6120000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":16.166,"5min":12.006,"15min":5.4139999999999997},"min":{"1min":1.153,"5min":1.0369999999999999,"15min":0.97199999999999998},"max":{"1min":37.853999999999999,"5min":44.856000000000002,"15min":44.856000000000002},"last":1.3069999999999999},{"interface":"front","average":{"1min":13.965999999999999,"5min":8.6259999999999994,"15min":4.2400000000000002},"min":{"1min":1.1870000000000001,"5min":1.115,"15min":1.115},"max":{"1min":37.468000000000004,"5min":44.020000000000003,"15min":44.020000000000003},"last":1.446}]},{"osd":10,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":16.541,"5min":12.448,"15min":5.6200000000000001},"min":{"1min":1.3049999999999999,"5min":1.254,"15min":1.2290000000000001},"max":{"1min":60.356000000000002,"5min":60.356000000000002,"15min":60.356000000000002},"last":1.696},{"interface":"front","average":{"1min":17.852,"5min":13.135,"15min":5.8959999999999999},"min":{"1min":1.3169999999999999,"5min":1.1020000000000001,"15min":1.0269999999999999},"max":{"1min":61.103999999999999,"5min":61.103999999999999,"15min":61.103999999999999},"last":1.4279999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:01:41 2020","interfaces":[{"interface":"back","average":{"1min":11.356999999999999,"5min":8.3879999999999999,"15min":4.157},"min":{"1min":1.327,"5min":1.2170000000000001,"15min":0.92300000000000004},"max":{"1min":31.670000000000002,"5min":39.838999999999999,"15min":39.838999999999999},"last":1.7190000000000001},{"interface":"front","average":{"1min":16.690999999999999,"5min":9.9670000000000005,"15min":4.7990000000000004},"min":{"1min":1.2330000000000001,"5min":1.212,"15min":1.125},"max":{"1min":60.219999999999999,"5min":60.219999999999999,"15min":60.219999999999999},"last":1.7749999999999999}]}]},{"osd":7,"up_from":17,"seq":73014444180,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":441384,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":441088,"kb_avail":93930456,"statfs":{"total":96636764160,"available":96184786944,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":451674112},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":6.9240000000000004,"5min":3.891,"15min":2.169},"min":{"1min":0.629,"5min":0.629,"15min":0.52600000000000002},"max":{"1min":26.654,"5min":31.739000000000001,"15min":31.739000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":6.8499999999999996,"5min":4.9409999999999998,"15min":2.726},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59299999999999997},"max":{"1min":36.250999999999998,"5min":48.305,"15min":48.305},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":4.569,"5min":3.988,"15min":2.2999999999999998},"min":{"1min":0.65800000000000003,"5min":0.64700000000000002,"15min":0.56599999999999995},"max":{"1min":25.803000000000001,"5min":25.803000000000001,"15min":25.803000000000001},"last":0.871},{"interface":"front","average":{"1min":10.651999999999999,"5min":4.944,"15min":2.8610000000000002},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":30.164999999999999,"5min":30.164999999999999,"15min":30.164999999999999},"last":1.5489999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":18.428000000000001,"5min":11.936,"15min":5.024},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.51100000000000001},"max":{"1min":50.595999999999997,"5min":55.094999999999999,"15min":55.094999999999999},"last":1.083},{"interface":"front","average":{"1min":16.302,"5min":10.824999999999999,"15min":4.6440000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.55700000000000005},"max":{"1min":51.548000000000002,"5min":54.805,"15min":54.805},"last":1.1240000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":12.029,"5min":6.0099999999999998,"15min":3.169},"min":{"1min":0.93300000000000005,"5min":0.755,"15min":0.72499999999999998},"max":{"1min":50.558,"5min":50.558,"15min":50.558},"last":1.0129999999999999},{"interface":"front","average":{"1min":7.2779999999999996,"5min":5.2640000000000002,"15min":2.8479999999999999},"min":{"1min":0.82599999999999996,"5min":0.77500000000000002,"15min":0.73299999999999998},"max":{"1min":26.581,"5min":47.828000000000003,"15min":47.828000000000003},"last":1.3069999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":10.159000000000001,"5min":5.7480000000000002,"15min":3.3420000000000001},"min":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":34.765999999999998,"5min":48.515000000000001,"15min":57.018000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":9.1780000000000008,"5min":5.9589999999999996,"15min":3.4420000000000002},"min":{"1min":1.022,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":36.494999999999997,"5min":48.432000000000002,"15min":65.472999999999999},"last":1.516}]},{"osd":6,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":8.5579999999999998,"5min":7.6340000000000003,"15min":3.7999999999999998},"min":{"1min":1.179,"5min":1.0389999999999999,"15min":0.82499999999999996},"max":{"1min":26.876000000000001,"5min":54.665999999999997,"15min":54.665999999999997},"last":1.4650000000000001},{"interface":"front","average":{"1min":10.31,"5min":6.7149999999999999,"15min":3.6589999999999998},"min":{"1min":1.175,"5min":1.175,"15min":0.78600000000000003},"max":{"1min":35.107999999999997,"5min":48.649000000000001,"15min":48.649000000000001},"last":1.8799999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":14.885999999999999,"5min":10.472,"15min":4.7439999999999998},"min":{"1min":1.1299999999999999,"5min":0.90600000000000003,"15min":0.85699999999999998},"max":{"1min":60.439999999999998,"5min":60.439999999999998,"15min":60.439999999999998},"last":1.643},{"interface":"front","average":{"1min":15.609,"5min":11.731999999999999,"15min":5.4500000000000002},"min":{"1min":1.3839999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":51.673000000000002,"5min":54.93,"15min":57.436},"last":1.754}]},{"osd":9,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":12.881,"5min":7.891,"15min":4.1509999999999998},"min":{"1min":1.6399999999999999,"5min":1.1559999999999999,"15min":1.1040000000000001},"max":{"1min":34.847000000000001,"5min":34.847000000000001,"15min":34.847000000000001},"last":2.0760000000000001},{"interface":"front","average":{"1min":8.3979999999999997,"5min":7.9290000000000003,"15min":4.1020000000000003},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":0.94899999999999995},"max":{"1min":36.601999999999997,"5min":48.563000000000002,"15min":48.563000000000002},"last":1.3919999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":14.691000000000001,"5min":9.1999999999999993,"15min":4.4980000000000002},"min":{"1min":1.26,"5min":1.26,"15min":0.81200000000000006},"max":{"1min":51.338999999999999,"5min":51.338999999999999,"15min":51.338999999999999},"last":1.6100000000000001},{"interface":"front","average":{"1min":17.420999999999999,"5min":9.3740000000000006,"15min":4.6619999999999999},"min":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.0509999999999999},"max":{"1min":83.480999999999995,"5min":83.480999999999995,"15min":83.480999999999995},"last":2.218}]},{"osd":11,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":9.5690000000000008,"5min":7.4219999999999997,"15min":3.9689999999999999},"min":{"1min":1.2869999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":36.710000000000001,"5min":56.963000000000001,"15min":56.963000000000001},"last":1.7270000000000001},{"interface":"front","average":{"1min":14.188000000000001,"5min":9.3800000000000008,"15min":4.6150000000000002},"min":{"1min":1.3069999999999999,"5min":1.141,"15min":1.141},"max":{"1min":50.468000000000004,"5min":57.441000000000003,"15min":57.441000000000003},"last":1.9279999999999999}]}]},{"osd":6,"up_from":17,"seq":73014444178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438384,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":438080,"kb_avail":93933456,"statfs":{"total":96636764160,"available":96187858944,"internally_reserved":0,"allocated":303104,"data_stored":136546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":448593920},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":2.2200000000000002,"15min":2.0449999999999999},"min":{"1min":0.67900000000000005,"5min":0.627,"15min":0.627},"max":{"1min":5.4089999999999998,"5min":9.2400000000000002,"15min":54.784999999999997},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.796,"15min":1.7070000000000001},"min":{"1min":0.61199999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.4660000000000002,"5min":8.3819999999999997,"15min":55.107999999999997},"last":1.073}]},{"osd":2,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":12.766,"5min":6.609,"15min":3.4209999999999998},"min":{"1min":0.63600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":30.675999999999998,"5min":52.994999999999997,"15min":52.994999999999997},"last":0.79300000000000004},{"interface":"front","average":{"1min":14.324,"5min":7.9809999999999999,"15min":4.0709999999999997},"min":{"1min":0.79500000000000004,"5min":0.68600000000000005,"15min":0.68200000000000005},"max":{"1min":38.560000000000002,"5min":54.621000000000002,"15min":54.621000000000002},"last":0.745}]},{"osd":3,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":2.6190000000000002,"15min":2.1600000000000001},"min":{"1min":0.89900000000000002,"5min":0.85299999999999998,"15min":0.66500000000000004},"max":{"1min":5.923,"5min":9.3569999999999993,"15min":14.118},"last":0.877},{"interface":"front","average":{"1min":1.6930000000000001,"5min":2.2639999999999998,"15min":1.738},"min":{"1min":0.82099999999999995,"5min":0.69799999999999995,"15min":0.66400000000000003},"max":{"1min":3.7160000000000002,"5min":8.9909999999999997,"15min":10.124000000000001},"last":0.71299999999999997}]},{"osd":4,"last update":"Fri Nov 20 12:02:00 2020","interfaces":[{"interface":"back","average":{"1min":2.8570000000000002,"5min":2.4289999999999998,"15min":1.95},"min":{"1min":0.998,"5min":0.83399999999999996,"15min":0.81200000000000006},"max":{"1min":18.498999999999999,"5min":18.498999999999999,"15min":18.498999999999999},"last":1.383},{"interface":"front","average":{"1min":1.3700000000000001,"5min":2.1699999999999999,"15min":1.9990000000000001},"min":{"1min":0.752,"5min":0.68600000000000005,"15min":0.68200000000000005},"max":{"1min":2.653,"5min":15.196,"15min":37.557000000000002},"last":1.353}]},{"osd":5,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":3.0840000000000001,"5min":3.3410000000000002,"15min":2.4329999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":14.662000000000001,"5min":19.068999999999999,"15min":19.068999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":2.044,"5min":2.907,"15min":2.2440000000000002},"min":{"1min":0.91500000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":4.319,"5min":17.635999999999999,"15min":17.635999999999999},"last":1.036}]},{"osd":7,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":5.6280000000000001,"5min":5.625,"15min":3.7919999999999998},"min":{"1min":1.6379999999999999,"5min":1.0800000000000001,"15min":1.03},"max":{"1min":19.704000000000001,"5min":25.669,"15min":63.908999999999999},"last":1.462},{"interface":"front","average":{"1min":5.4390000000000001,"5min":5.5209999999999999,"15min":3.29},"min":{"1min":1.4330000000000001,"5min":1.1319999999999999,"15min":1.01},"max":{"1min":19.827999999999999,"5min":24.888000000000002,"15min":40.161000000000001},"last":1.1930000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":7.8620000000000001,"5min":6.1280000000000001,"15min":3.3849999999999998},"min":{"1min":1.056,"5min":0.95099999999999996,"15min":0.91500000000000004},"max":{"1min":37.609999999999999,"5min":46.223999999999997,"15min":46.223999999999997},"last":1.175},{"interface":"front","average":{"1min":8.452,"5min":7.5410000000000004,"15min":4.2919999999999998},"min":{"1min":1.375,"5min":1.254,"15min":0.754},"max":{"1min":38.688000000000002,"5min":46.268000000000001,"15min":46.268000000000001},"last":1.3200000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":4.4509999999999996,"5min":3.71,"15min":2.7389999999999999},"min":{"1min":1.4179999999999999,"5min":1.091,"15min":1.0640000000000001},"max":{"1min":37.701000000000001,"5min":37.701000000000001,"15min":37.701000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":5.6539999999999999,"5min":3.9990000000000001,"15min":2.9540000000000002},"min":{"1min":1.028,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":38.225000000000001,"5min":38.225000000000001,"15min":38.225000000000001},"last":1.2569999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":2.7839999999999998,"5min":3.9980000000000002,"15min":3.2349999999999999},"min":{"1min":1.585,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":5.7199999999999998,"5min":54.341000000000001,"15min":54.341000000000001},"last":1.5900000000000001},{"interface":"front","average":{"1min":3.5640000000000001,"5min":3.6379999999999999,"15min":2.7450000000000001},"min":{"1min":1.486,"5min":1.028,"15min":1.028},"max":{"1min":21.213999999999999,"5min":21.213999999999999,"15min":37.408000000000001},"last":1.4870000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:01:47 2020","interfaces":[{"interface":"back","average":{"1min":2.472,"5min":2.9590000000000001,"15min":2.5299999999999998},"min":{"1min":1.1899999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":5.0129999999999999,"5min":15.555999999999999,"15min":15.686},"last":1.4279999999999999},{"interface":"front","average":{"1min":2.8319999999999999,"5min":3.2160000000000002,"15min":2.9159999999999999},"min":{"1min":1.3260000000000001,"5min":1.3140000000000001,"15min":1.006},"max":{"1min":5.798,"5min":15.385,"15min":15.871},"last":1.71}]}]},{"osd":1,"up_from":17,"seq":73014444180,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217256,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":216960,"kb_avail":94154584,"statfs":{"total":96636764160,"available":96414294016,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":222167040},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.851,"15min":1.6259999999999999},"min":{"1min":0.65200000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":9.1549999999999994,"5min":13.398,"15min":13.398},"last":1.194},{"interface":"front","average":{"1min":1.7490000000000001,"5min":2.0499999999999998,"15min":1.623},"min":{"1min":0.67200000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":8.8740000000000006,"5min":8.8740000000000006,"15min":8.8740000000000006},"last":1.3049999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":6.8550000000000004,"5min":5.6630000000000003,"15min":2.8740000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.65000000000000002},"max":{"1min":19.198,"5min":28.064,"15min":28.064},"last":1.3759999999999999},{"interface":"front","average":{"1min":8.1270000000000007,"5min":6.077,"15min":3.0569999999999999},"min":{"1min":0.89100000000000001,"5min":0.66800000000000004,"15min":0.64900000000000002},"max":{"1min":19.329000000000001,"5min":28.161000000000001,"15min":28.161000000000001},"last":1.357}]},{"osd":3,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.661,"15min":1.5589999999999999},"min":{"1min":0.72699999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.3940000000000001,"5min":6.266,"15min":8.8119999999999994},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.3080000000000001,"5min":2.0449999999999999,"15min":1.675},"min":{"1min":0.77000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":3.242,"5min":12.047000000000001,"15min":12.047000000000001},"last":0.96299999999999997}]},{"osd":4,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.853,"15min":1.657},"min":{"1min":0.83899999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":3.0099999999999998,"5min":8.2989999999999995,"15min":8.8249999999999993},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.502,"5min":1.9790000000000001,"15min":1.923},"min":{"1min":0.96599999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":3.0859999999999999,"5min":7.6849999999999996,"15min":11.539},"last":1.6040000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":2.625,"15min":2.0289999999999999},"min":{"1min":0.72099999999999997,"5min":0.623,"15min":0.623},"max":{"1min":9.3610000000000007,"5min":19.629999999999999,"15min":19.629999999999999},"last":1.23},{"interface":"front","average":{"1min":2.032,"5min":2.7029999999999998,"15min":2.4049999999999998},"min":{"1min":0.96599999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":9.0549999999999997,"5min":20.350000000000001,"15min":84.078999999999994},"last":1.536}]},{"osd":6,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":2.419,"5min":2.6400000000000001,"15min":2.3570000000000002},"min":{"1min":1.1379999999999999,"5min":0.751,"15min":0.751},"max":{"1min":10.849,"5min":12.823,"15min":26.498999999999999},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.804,"5min":2.2090000000000001,"15min":2.1269999999999998},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":4.8799999999999999,"5min":11.605,"15min":26.181999999999999},"last":1.4450000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":5.4320000000000004,"5min":5.2770000000000001,"15min":3.0579999999999998},"min":{"1min":1.2929999999999999,"5min":1.0620000000000001,"15min":1.024},"max":{"1min":24.317,"5min":30.716000000000001,"15min":30.716000000000001},"last":1.71},{"interface":"front","average":{"1min":5.0460000000000003,"5min":5.1790000000000003,"15min":3.4510000000000001},"min":{"1min":1.131,"5min":1.131,"15min":1.131},"max":{"1min":24.274999999999999,"5min":30.577000000000002,"15min":82.388999999999996},"last":1.742}]},{"osd":8,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":7.1420000000000003,"5min":6.8369999999999997,"15min":3.6779999999999999},"min":{"1min":1.161,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":19.797999999999998,"5min":40.718000000000004,"15min":40.718000000000004},"last":1.675},{"interface":"front","average":{"1min":6.9729999999999999,"5min":6.0739999999999998,"15min":3.407},"min":{"1min":1.381,"5min":1.163,"15min":1.163},"max":{"1min":19.722999999999999,"5min":31.696000000000002,"15min":31.696000000000002},"last":1.861}]},{"osd":9,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":2.9569999999999999,"15min":2.7829999999999999},"min":{"1min":1.3300000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":10.068,"5min":15.138,"15min":84.161000000000001},"last":2.0059999999999998},{"interface":"front","average":{"1min":2.625,"5min":2.7349999999999999,"15min":2.7669999999999999},"min":{"1min":1.2509999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":10.423,"5min":14.737,"15min":82.528000000000006},"last":1.827}]},{"osd":11,"last update":"Fri Nov 20 12:01:50 2020","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":2.8300000000000001,"15min":2.4620000000000002},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":3.6589999999999998,"5min":11.734,"15min":11.734},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.9530000000000001,"5min":2.7290000000000001,"15min":2.456},"min":{"1min":1.3700000000000001,"5min":1.163,"15min":1.163},"max":{"1min":3.8380000000000001,"5min":9.6880000000000006,"15min":9.6880000000000006},"last":2.1509999999999998}]}]},{"osd":0,"up_from":17,"seq":73014444178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307112,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":306816,"kb_avail":94064728,"statfs":{"total":96636764160,"available":96322281472,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":314179584},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":3.1859999999999999,"5min":2.6309999999999998,"15min":1.8939999999999999},"min":{"1min":0.71499999999999997,"5min":0.65400000000000003,"15min":0.64800000000000002},"max":{"1min":19.533000000000001,"5min":70.542000000000002,"15min":70.542000000000002},"last":1.103},{"interface":"front","average":{"1min":2.5739999999999998,"5min":2.5099999999999998,"15min":1.804},"min":{"1min":0.63,"5min":0.63,"15min":0.621},"max":{"1min":21.091999999999999,"5min":70.581999999999994,"15min":70.581999999999994},"last":1.0740000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":13.818,"5min":6.8499999999999996,"15min":3.4929999999999999},"min":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.57099999999999995},"max":{"1min":38.311999999999998,"5min":56.567,"15min":56.567},"last":0.999},{"interface":"front","average":{"1min":13.390000000000001,"5min":7.4059999999999997,"15min":3.714},"min":{"1min":0.879,"5min":0.75600000000000001,"15min":0.59099999999999997},"max":{"1min":39.043999999999997,"5min":54.677,"15min":54.677},"last":1.244}]},{"osd":3,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":4.6280000000000001,"5min":2.5649999999999999,"15min":1.982},"min":{"1min":0.72099999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":21.279,"5min":21.279,"15min":21.279},"last":0.66700000000000004},{"interface":"front","average":{"1min":3.7349999999999999,"5min":2.4119999999999999,"15min":1.905},"min":{"1min":0.876,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":20.106000000000002,"5min":20.106000000000002,"15min":20.106000000000002},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":3.645,"5min":3.226,"15min":2.0990000000000002},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":23.719999999999999,"5min":71.278999999999996,"15min":71.278999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":4.6100000000000003,"5min":3.4470000000000001,"15min":2.3999999999999999},"min":{"1min":0.73499999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":22.428000000000001,"5min":70.400000000000006,"15min":70.400000000000006},"last":0.89900000000000002}]},{"osd":5,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":5.7919999999999998,"5min":3.875,"15min":2.6600000000000001},"min":{"1min":1.175,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":25.655999999999999,"5min":28.562999999999999,"15min":28.562999999999999},"last":1.375},{"interface":"front","average":{"1min":4.8280000000000003,"5min":3.581,"15min":2.4550000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.65900000000000003},"max":{"1min":25.934999999999999,"5min":28.533999999999999,"15min":28.533999999999999},"last":1.2929999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":4.6920000000000002,"5min":3.2040000000000002,"15min":2.589},"min":{"1min":0.94099999999999995,"5min":0.92300000000000004,"15min":0.81299999999999994},"max":{"1min":22.518999999999998,"5min":22.518999999999998,"15min":22.518999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":5.6459999999999999,"5min":3.4660000000000002,"15min":2.6509999999999998},"min":{"1min":1.4550000000000001,"5min":0.94199999999999995,"15min":0.89300000000000002},"max":{"1min":24.466000000000001,"5min":24.466000000000001,"15min":24.466000000000001},"last":0.95999999999999996}]},{"osd":7,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":7.2160000000000002,"5min":5.7190000000000003,"15min":3.3279999999999998},"min":{"1min":1.137,"5min":1.022,"15min":0.96499999999999997},"max":{"1min":24.622,"5min":72.611000000000004,"15min":72.611000000000004},"last":0.93000000000000005},{"interface":"front","average":{"1min":6.0819999999999999,"5min":5.7199999999999998,"15min":3.4340000000000002},"min":{"1min":1.258,"5min":1.008,"15min":1.008},"max":{"1min":24.332999999999998,"5min":84.977999999999994,"15min":84.977999999999994},"last":1.1659999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":12.308999999999999,"5min":7.7140000000000004,"15min":4.0519999999999996},"min":{"1min":1.264,"5min":1.03,"15min":0.89500000000000002},"max":{"1min":26.106999999999999,"5min":28.295999999999999,"15min":28.295999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":10.15,"5min":7.1289999999999996,"15min":3.96},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":23.861999999999998,"5min":26.969999999999999,"15min":26.969999999999999},"last":1.089}]},{"osd":9,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":6.7400000000000002,"5min":3.7450000000000001,"15min":3.0470000000000002},"min":{"1min":1.444,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":29.007999999999999,"5min":29.007999999999999,"15min":29.007999999999999},"last":1.4950000000000001},{"interface":"front","average":{"1min":4.8419999999999996,"5min":3.4529999999999998,"15min":2.8599999999999999},"min":{"1min":1.3500000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":24.728000000000002,"5min":24.728000000000002,"15min":24.728000000000002},"last":1.222}]},{"osd":11,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":5.0599999999999996,"5min":3.4039999999999999,"15min":2.778},"min":{"1min":1.341,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":22.533999999999999,"5min":22.533999999999999,"15min":22.533999999999999},"last":1.625},{"interface":"front","average":{"1min":4.6719999999999997,"5min":3.3639999999999999,"15min":2.7109999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":26.276,"5min":26.276,"15min":26.276},"last":1.357}]}]},{"osd":2,"up_from":17,"seq":73014444179,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424432,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":424128,"kb_avail":93947408,"statfs":{"total":96636764160,"available":96202145792,"internally_reserved":0,"allocated":303104,"data_stored":136546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":434307072},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":8.6310000000000002,"5min":6.2649999999999997,"15min":3.2989999999999999},"min":{"1min":0.54400000000000004,"5min":0.501,"15min":0.501},"max":{"1min":30.646999999999998,"5min":30.646999999999998,"15min":30.646999999999998},"last":1.1719999999999999},{"interface":"front","average":{"1min":6.593,"5min":5.9000000000000004,"15min":3.2250000000000001},"min":{"1min":0.72699999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":30.774000000000001,"5min":41.847000000000001,"15min":41.847000000000001},"last":1.4770000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":7.335,"5min":5.1829999999999998,"15min":2.7200000000000002},"min":{"1min":0.61299999999999999,"5min":0.60699999999999998,"15min":0.55400000000000005},"max":{"1min":30.812000000000001,"5min":30.812000000000001,"15min":30.812000000000001},"last":0.753},{"interface":"front","average":{"1min":8.1010000000000009,"5min":6.2619999999999996,"15min":3.0680000000000001},"min":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.56299999999999994},"max":{"1min":30.920000000000002,"5min":41.978999999999999,"15min":41.978999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":14.132,"5min":7.1820000000000004,"15min":3.4079999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.60199999999999998},"max":{"1min":38.066000000000003,"5min":38.066000000000003,"15min":38.066000000000003},"last":1.71},{"interface":"front","average":{"1min":9.5570000000000004,"5min":6.9829999999999997,"15min":3.3199999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":31.047999999999998,"5min":41.701999999999998,"15min":41.701999999999998},"last":1.2030000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":12.122999999999999,"5min":7.1669999999999998,"15min":3.5070000000000001},"min":{"1min":1.056,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":37.841000000000001,"5min":37.841000000000001,"15min":37.841000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":11.273,"5min":7.5339999999999998,"15min":3.802},"min":{"1min":1.161,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":31.331,"5min":42.112000000000002,"15min":42.112000000000002},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":16.876000000000001,"5min":9.8699999999999992,"15min":4.5970000000000004},"min":{"1min":1.3120000000000001,"5min":1.0509999999999999,"15min":0.80500000000000005},"max":{"1min":52.463000000000001,"5min":52.463000000000001,"15min":52.463000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":10.109999999999999,"5min":6.2510000000000003,"15min":3.1749999999999998},"min":{"1min":0.78900000000000003,"5min":0.70999999999999996,"15min":0.63600000000000001},"max":{"1min":51.593000000000004,"5min":51.593000000000004,"15min":51.593000000000004},"last":0.996}]},{"osd":7,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":13.430999999999999,"5min":10.945,"15min":4.9790000000000001},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":0.92800000000000005},"max":{"1min":37.981999999999999,"5min":53.091999999999999,"15min":53.091999999999999},"last":1.026},{"interface":"front","average":{"1min":15.847,"5min":11.459,"15min":5.1289999999999996},"min":{"1min":1.0760000000000001,"5min":1.016,"15min":0.88400000000000001},"max":{"1min":38.770000000000003,"5min":54.316000000000003,"15min":54.316000000000003},"last":1.097}]},{"osd":8,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":11.419,"5min":12.723000000000001,"15min":5.2149999999999999},"min":{"1min":0.78200000000000003,"5min":0.71299999999999997,"15min":0.67100000000000004},"max":{"1min":37.954000000000001,"5min":42.186999999999998,"15min":42.186999999999998},"last":0.83199999999999996},{"interface":"front","average":{"1min":14.962999999999999,"5min":17.157,"15min":7.1639999999999997},"min":{"1min":1.3799999999999999,"5min":1.1579999999999999,"15min":1.0229999999999999},"max":{"1min":44.622,"5min":53.581000000000003,"15min":53.581000000000003},"last":1.5880000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":14.906000000000001,"5min":10.263999999999999,"15min":4.9269999999999996},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":31.460999999999999,"5min":42.360999999999997,"15min":42.360999999999997},"last":1.369},{"interface":"front","average":{"1min":11.281000000000001,"5min":7.5279999999999996,"15min":3.6230000000000002},"min":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.82199999999999995},"max":{"1min":37.781999999999996,"5min":37.781999999999996,"15min":37.781999999999996},"last":1.131}]},{"osd":10,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":13.02,"5min":9.7680000000000007,"15min":4.8159999999999998},"min":{"1min":1.345,"5min":1.1619999999999999,"15min":1.008},"max":{"1min":31.437000000000001,"5min":32.781999999999996,"15min":32.781999999999996},"last":1.3149999999999999},{"interface":"front","average":{"1min":14.052,"5min":10.194000000000001,"15min":4.976},"min":{"1min":1.3069999999999999,"5min":1.1539999999999999,"15min":0.99099999999999999},"max":{"1min":35.707999999999998,"5min":42.966999999999999,"15min":42.966999999999999},"last":1.556}]},{"osd":11,"last update":"Fri Nov 20 12:01:52 2020","interfaces":[{"interface":"back","average":{"1min":5.7999999999999998,"5min":4.9690000000000003,"15min":2.7490000000000001},"min":{"1min":0.95699999999999996,"5min":0.93000000000000005,"15min":0.80400000000000005},"max":{"1min":32.301000000000002,"5min":32.301000000000002,"15min":32.301000000000002},"last":1.218},{"interface":"front","average":{"1min":15.843,"5min":9.5020000000000007,"15min":4.6040000000000001},"min":{"1min":1.286,"5min":1.1890000000000001,"15min":1.081},"max":{"1min":44.747,"5min":44.747,"15min":44.747},"last":1.8360000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444180,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123492,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":122816,"kb_avail":94248348,"statfs":{"total":96636764160,"available":96510308352,"internally_reserved":0,"allocated":684032,"data_stored":517345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":125763584},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":4.2210000000000001,"5min":2.4359999999999999,"15min":1.8049999999999999},"min":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.58799999999999997},"max":{"1min":22.856000000000002,"5min":22.856000000000002,"15min":22.856000000000002},"last":0.89300000000000002},{"interface":"front","average":{"1min":3.6840000000000002,"5min":2.1819999999999999,"15min":1.7370000000000001},"min":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.61199999999999999},"max":{"1min":19.210999999999999,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.93500000000000005}]},{"osd":2,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":9.6300000000000008,"5min":7.7460000000000004,"15min":3.754},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":28.315000000000001,"5min":47.859999999999999,"15min":47.859999999999999},"last":1.276},{"interface":"front","average":{"1min":9.2880000000000003,"5min":7.1609999999999996,"15min":3.5539999999999998},"min":{"1min":0.81200000000000006,"5min":0.73999999999999999,"15min":0.71699999999999997},"max":{"1min":28.369,"5min":51.231999999999999,"15min":51.231999999999999},"last":1.359}]},{"osd":4,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":2.4809999999999999,"15min":1.756},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.0270000000000001,"5min":47.366999999999997,"15min":47.366999999999997},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.4370000000000001,"5min":2.766,"15min":2.0600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.6469999999999998,"5min":47.561999999999998,"15min":47.561999999999998},"last":1.405}]},{"osd":5,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.9180000000000001,"5min":3.488,"15min":2.4460000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":16.207999999999998,"5min":48.454999999999998,"15min":48.454999999999998},"last":1.502},{"interface":"front","average":{"1min":3.1560000000000001,"5min":3.645,"15min":2.3780000000000001},"min":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":16.050999999999998,"5min":47.738,"15min":47.738},"last":1.181}]},{"osd":6,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":3.2589999999999999,"5min":3.3010000000000002,"15min":2.2930000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.64300000000000002},"max":{"1min":19.969000000000001,"5min":51.186,"15min":51.186},"last":0.97199999999999998},{"interface":"front","average":{"1min":4.2370000000000001,"5min":4.1479999999999997,"15min":2.8809999999999998},"min":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":0.95199999999999996},"max":{"1min":20.757000000000001,"5min":48.158999999999999,"15min":48.158999999999999},"last":1.5389999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":5.54,"5min":6.0970000000000004,"15min":3.4199999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":17.635999999999999,"5min":60.584000000000003,"15min":60.584000000000003},"last":1.6339999999999999},{"interface":"front","average":{"1min":4.0179999999999998,"5min":5.923,"15min":3.306},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":14.035,"5min":60.103000000000002,"15min":60.103000000000002},"last":1.796}]},{"osd":8,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":12.840999999999999,"5min":9.0090000000000003,"15min":4.492},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":49.238,"5min":54.895000000000003,"15min":54.895000000000003},"last":1.6559999999999999},{"interface":"front","average":{"1min":13.085000000000001,"5min":9.4719999999999995,"15min":4.5270000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.872},"max":{"1min":50.107999999999997,"5min":55.241,"15min":55.241},"last":1.476}]},{"osd":9,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":3.718,"5min":3.8130000000000002,"15min":2.847},"min":{"1min":1.3580000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":12.048,"5min":48.261000000000003,"15min":48.261000000000003},"last":1.7150000000000001},{"interface":"front","average":{"1min":3.5750000000000002,"5min":3.9809999999999999,"15min":3.0139999999999998},"min":{"1min":1.353,"5min":1.085,"15min":1.085},"max":{"1min":12.147,"5min":50.363999999999997,"15min":50.363999999999997},"last":1.929}]},{"osd":10,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":3.7810000000000001,"15min":2.6779999999999999},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":0.97899999999999998},"max":{"1min":3.2309999999999999,"5min":54.128999999999998,"15min":54.128999999999998},"last":1.5649999999999999},{"interface":"front","average":{"1min":2.956,"5min":4.3419999999999996,"15min":3.0139999999999998},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":15.356999999999999,"5min":51.743000000000002,"15min":51.743000000000002},"last":1.827}]},{"osd":11,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.1339999999999999,"5min":3.2919999999999998,"15min":2.6930000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":4.835,"5min":48.630000000000003,"15min":48.630000000000003},"last":2.0609999999999999},{"interface":"front","average":{"1min":1.8540000000000001,"5min":3.2210000000000001,"15min":2.5419999999999998},"min":{"1min":1.157,"5min":1.117,"15min":1.073},"max":{"1min":3.4409999999999998,"5min":48.878,"15min":48.878},"last":1.6870000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444180,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120624,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":120320,"kb_avail":94251216,"statfs":{"total":96636764160,"available":96513245184,"internally_reserved":0,"allocated":303104,"data_stored":138126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":123207680},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":4.609,"5min":3.2589999999999999,"15min":2.056},"min":{"1min":0.65400000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":31.465,"5min":102.258,"15min":102.258},"last":1.173},{"interface":"front","average":{"1min":5.1150000000000002,"5min":3.4329999999999998,"15min":2.008},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":31.693999999999999,"5min":102.45,"15min":102.45},"last":1.1950000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":1.958,"5min":2.1150000000000002,"15min":1.474},"min":{"1min":0.63400000000000001,"5min":0.60599999999999998,"15min":0.55900000000000005},"max":{"1min":6.5650000000000004,"5min":47.159999999999997,"15min":47.159999999999997},"last":1.143},{"interface":"front","average":{"1min":2.206,"5min":2.2719999999999998,"15min":1.671},"min":{"1min":0.76000000000000001,"5min":0.622,"15min":0.57499999999999996},"max":{"1min":6.9130000000000003,"5min":48.533000000000001,"15min":48.533000000000001},"last":1.663}]},{"osd":3,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.897,"15min":1.6299999999999999},"min":{"1min":0.73999999999999999,"5min":0.68899999999999995,"15min":0.60799999999999998},"max":{"1min":7.5789999999999997,"5min":12.468999999999999,"15min":14.170999999999999},"last":1.4750000000000001},{"interface":"front","average":{"1min":2.2450000000000001,"5min":2.1669999999999998,"15min":1.8660000000000001},"min":{"1min":0.97299999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":6.6870000000000003,"5min":12.577999999999999,"15min":41.307000000000002},"last":1.4259999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.3090000000000002,"5min":2.5329999999999999,"15min":2.0990000000000002},"min":{"1min":0.86699999999999999,"5min":0.751,"15min":0.751},"max":{"1min":7.2670000000000003,"5min":13.441000000000001,"15min":19.434999999999999},"last":1.51},{"interface":"front","average":{"1min":1.8089999999999999,"5min":2.4169999999999998,"15min":2.004},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.67900000000000005},"max":{"1min":7.7140000000000004,"5min":17.093,"15min":17.093},"last":1.6259999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.8399999999999999,"5min":3.7930000000000001,"15min":2.5129999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":7.5199999999999996,"5min":105.96899999999999,"15min":105.96899999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":3.629,"5min":3.9929999999999999,"15min":2.6970000000000001},"min":{"1min":0.91500000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":14.788,"5min":100.04600000000001,"15min":100.04600000000001},"last":1.577}]},{"osd":7,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":5.5060000000000002,"5min":7.133,"15min":3.9289999999999998},"min":{"1min":1.4870000000000001,"5min":1.026,"15min":1.0069999999999999},"max":{"1min":21.757000000000001,"5min":161.50700000000001,"15min":161.50700000000001},"last":1.7629999999999999},{"interface":"front","average":{"1min":4.8120000000000003,"5min":6.4889999999999999,"15min":3.5819999999999999},"min":{"1min":0.96099999999999997,"5min":0.94499999999999995,"15min":0.93300000000000005},"max":{"1min":21.68,"5min":163.98400000000001,"15min":163.98400000000001},"last":1.74}]},{"osd":8,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":6.7649999999999997,"5min":6.3460000000000001,"15min":3.8380000000000001},"min":{"1min":1.3700000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":21.48,"5min":62.640000000000001,"15min":69.906999999999996},"last":1.7110000000000001},{"interface":"front","average":{"1min":7.8380000000000001,"5min":6.8159999999999998,"15min":4.1959999999999997},"min":{"1min":1.3280000000000001,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":23.038,"5min":31.582000000000001,"15min":69.778999999999996},"last":1.8700000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":3.206,"5min":3.8180000000000001,"15min":2.6909999999999998},"min":{"1min":1.165,"5min":1.0009999999999999,"15min":0.94599999999999995},"max":{"1min":7.3170000000000002,"5min":101.361,"15min":101.361},"last":1.8200000000000001},{"interface":"front","average":{"1min":3.3730000000000002,"5min":4.1959999999999997,"15min":3.012},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":10.122999999999999,"5min":100.304,"15min":100.304},"last":1.9730000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":4.0830000000000002,"5min":3.895,"15min":2.7789999999999999},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":35.225999999999999,"5min":35.225999999999999,"15min":42.716000000000001},"last":1.944},{"interface":"front","average":{"1min":4.6609999999999996,"5min":3.9500000000000002,"15min":2.8260000000000001},"min":{"1min":1.2509999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"max":{"1min":35.728000000000002,"5min":35.728000000000002,"15min":41.594000000000001},"last":1.909}]},{"osd":11,"last update":"Fri Nov 20 12:01:46 2020","interfaces":[{"interface":"back","average":{"1min":2.4940000000000002,"5min":2.3260000000000001,"15min":2.141},"min":{"1min":1.0449999999999999,"5min":1.0149999999999999,"15min":0.999},"max":{"1min":7.9569999999999999,"5min":7.9569999999999999,"15min":18.399999999999999},"last":1.8420000000000001},{"interface":"front","average":{"1min":2.9540000000000002,"5min":2.5139999999999998,"15min":2.21},"min":{"1min":1.2370000000000001,"5min":1.0980000000000001,"15min":1.056},"max":{"1min":7.4320000000000004,"5min":8.673,"15min":12.753},"last":1.9910000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444180,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236264,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":235968,"kb_avail":94135576,"statfs":{"total":96636764160,"available":96394829824,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":241631232},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":3.7589999999999999,"15min":2.3450000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":14.265000000000001,"5min":92.478999999999999,"15min":92.478999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":2.1280000000000001,"5min":3.6440000000000001,"15min":2.27},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.50900000000000001},"max":{"1min":13.882999999999999,"5min":92.281000000000006,"15min":92.281000000000006},"last":0.89700000000000002}]},{"osd":1,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":2.1970000000000001,"5min":2.1779999999999999,"15min":1.708},"min":{"1min":0.65700000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":14.005000000000001,"5min":23.925999999999998,"15min":23.925999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.8149999999999999,"5min":2.1920000000000002,"15min":1.6639999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":13.313000000000001,"5min":23.872,"15min":23.872},"last":1.23}]},{"osd":2,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":9.8480000000000008,"5min":7.782,"15min":3.585},"min":{"1min":0.94699999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":42.661999999999999,"5min":42.661999999999999,"15min":42.661999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":9.7739999999999991,"5min":6.3730000000000002,"15min":3.0910000000000002},"min":{"1min":0.97199999999999998,"5min":0.62,"15min":0.58499999999999996},"max":{"1min":39.201000000000001,"5min":40.118000000000002,"15min":40.118000000000002},"last":1.1919999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":1.8740000000000001,"5min":2.3109999999999999,"15min":1.7250000000000001},"min":{"1min":0.67900000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":13.679,"5min":24.416,"15min":24.416},"last":0.94899999999999995},{"interface":"front","average":{"1min":2.2229999999999999,"5min":2.7639999999999998,"15min":2.1230000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":14.544,"5min":25.056999999999999,"15min":25.056999999999999},"last":1.4239999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":4.0789999999999997,"5min":4.5819999999999999,"15min":2.8679999999999999},"min":{"1min":0.73299999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":21.658000000000001,"5min":92.433000000000007,"15min":92.433000000000007},"last":1.5149999999999999},{"interface":"front","average":{"1min":3.6080000000000001,"5min":4.2329999999999997,"15min":2.6349999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.63800000000000001},"max":{"1min":21.619,"5min":93.030000000000001,"15min":93.030000000000001},"last":1.393}]},{"osd":7,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":6.8129999999999997,"5min":4.5359999999999996,"15min":2.7029999999999998},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":23.489000000000001,"5min":28.178999999999998,"15min":28.178999999999998},"last":1.5649999999999999},{"interface":"front","average":{"1min":6.9429999999999996,"5min":5.1509999999999998,"15min":2.9910000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":26.337,"5min":27.550000000000001,"15min":27.550000000000001},"last":1.55}]},{"osd":8,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":10.869,"5min":7.9370000000000003,"15min":3.879},"min":{"1min":1.024,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":33.412999999999997,"5min":46.585999999999999,"15min":46.585999999999999},"last":1.7190000000000001},{"interface":"front","average":{"1min":8.9619999999999997,"5min":6.8280000000000003,"15min":3.4790000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.77700000000000002},"max":{"1min":32.5,"5min":32.5,"15min":32.5},"last":1.6719999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":3.2469999999999999,"5min":4.8550000000000004,"15min":3.3180000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":14.997999999999999,"5min":93.725999999999999,"15min":93.725999999999999},"last":1.645},{"interface":"front","average":{"1min":3.7040000000000002,"5min":5.0030000000000001,"15min":3.3199999999999998},"min":{"1min":1.079,"5min":1.0600000000000001,"15min":0.96399999999999997},"max":{"1min":14.153,"5min":93.593000000000004,"15min":93.593000000000004},"last":1.621}]},{"osd":10,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":3.0030000000000001,"5min":3.9590000000000001,"15min":2.7650000000000001},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":14.926,"5min":46.350999999999999,"15min":46.350999999999999},"last":1.744},{"interface":"front","average":{"1min":3.036,"5min":4.1139999999999999,"15min":2.7309999999999999},"min":{"1min":0.99299999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":15.037000000000001,"5min":46.466000000000001,"15min":46.466000000000001},"last":1.8049999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:01:44 2020","interfaces":[{"interface":"back","average":{"1min":2.899,"5min":3.206,"15min":2.4540000000000002},"min":{"1min":0.89800000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":13.801,"5min":28.012,"15min":28.012},"last":1.7649999999999999},{"interface":"front","average":{"1min":2.6920000000000002,"5min":3.601,"15min":2.7050000000000001},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":15.065,"5min":27.809000000000001,"15min":27.809000000000001},"last":1.831}]}]}]}} 2020-11-20T12:02:35.641 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-11-20T11:50:38.264765+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=38, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.642 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-11-20T11:50:32.131349+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=32, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.642 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-11-20T11:50:35.250749+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.643 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-11-20T11:50:38.264765+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=38, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.643 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-11-20T11:50:32.131349+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=32, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.643 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2020-11-20T11:50:35.250749+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.643 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-11-20T11:50:38.264765+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=38, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.644 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-20T11:50:32.131349+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=32, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.644 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2020-11-20T11:50:35.250749+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.644 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-11-20T11:50:38.264765+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=38, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.645 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-20T11:50:32.131349+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=32, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.645 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-20T11:50:22.155217+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=22, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.645 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2020-11-20T11:50:35.250749+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.646 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2020-11-20T11:50:38.264765+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=38, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.646 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-20T11:50:32.131349+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=32, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.646 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2020-11-20T11:50:35.250749+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.647 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-11-20T11:50:38.264765+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=38, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.647 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-20T11:50:32.131349+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=32, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.647 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-11-20T11:50:35.250749+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.647 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-11-20T11:50:38.264765+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=38, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.648 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-11-20T11:50:35.250749+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.648 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-20T11:50:32.131349+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=32, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.648 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-11-20T11:50:38.264765+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=38, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.649 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-20T11:50:32.131349+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=32, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.649 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-11-20T11:50:35.250749+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=50, tm_sec=35, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=2, tm_sec=29, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:02:35.649 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-11-20T12:02:55.651 INFO:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:02:55.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.772+0000 7fb173325700 1 Processor -- start 2020-11-20T12:02:55.775 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.772+0000 7fb173325700 1 -- start start 2020-11-20T12:02:55.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.773+0000 7fb173325700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb16c0c49b0 0x7fb16c15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:55.779 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.773+0000 7fb173325700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16c1516d0 con 0x7fb16c0bf9a0 2020-11-20T12:02:55.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.773+0000 7fb173325700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16c151970 con 0x7fb16c0bfd80 2020-11-20T12:02:55.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.773+0000 7fb173325700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16c151c10 con 0x7fb16c0c49b0 2020-11-20T12:02:55.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.773+0000 7fb1708c0700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fb16c0bfd80 0x7fb16c0c42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:56316/0 (socket says 172.21.15.164:56316) 2020-11-20T12:02:55.780 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.773+0000 7fb1708c0700 1 -- 172.21.15.164:0/3795003985 learned_addr learned my addr 172.21.15.164:0/3795003985 (peer_addr_for_me v1:172.21.15.164:0/0) 2020-11-20T12:02:55.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.773+0000 7fb1718c2700 1 --2- 172.21.15.164:0/3795003985 >> v2:172.21.15.36:3300/0 conn(0x7fb16c0c49b0 0x7fb16c15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:55.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.773+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457891076 0 0) 0x7fb16c151970 con 0x7fb16c0bfd80 2020-11-20T12:02:55.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.773+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb154003280 con 0x7fb16c0bfd80 2020-11-20T12:02:55.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222407983 0 0) 0x7fb16c1516d0 con 0x7fb16c0bf9a0 2020-11-20T12:02:55.781 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb16c151970 con 0x7fb16c0bf9a0 2020-11-20T12:02:55.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3479963479 0 0) 0x7fb154003280 con 0x7fb16c0bfd80 2020-11-20T12:02:55.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 >> v2:172.21.15.36:3300/0 conn(0x7fb16c0c49b0 msgr2=0x7fb16c15b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:55.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 --2- 172.21.15.164:0/3795003985 >> v2:172.21.15.36:3300/0 conn(0x7fb16c0c49b0 0x7fb16c15b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:55.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 >> v1:172.21.15.36:6789/0 conn(0x7fb16c0bf9a0 legacy=0x7fb16c0c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:55.782 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c151eb0 con 0x7fb16c0bfd80 2020-11-20T12:02:55.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586672192 0 0) 0x7fb160001560 con 0x7fb16c0bfd80 2020-11-20T12:02:55.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 >> v1:172.21.15.164:6789/0 conn(0x7fb16c0bfd80 legacy=0x7fb16c0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:55.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1540039a0 0x7fb154003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:55.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb154004520 0x7fb1540049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:55.783 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb154004e90 0x7fb15400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:55.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c151c10 con 0x7fb1540039a0 2020-11-20T12:02:55.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15400bc60 con 0x7fb154004520 2020-11-20T12:02:55.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15400bda0 con 0x7fb154004e90 2020-11-20T12:02:55.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1708c0700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb154004520 0x7fb1540049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:55.784 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1710c1700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1540039a0 0x7fb154003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:55.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1718c2700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb154004e90 0x7fb15400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:55.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1708c0700 1 -- 172.21.15.164:0/3795003985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb154004e90 msgr2=0x7fb15400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:55.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1708c0700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb154004e90 0x7fb15400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:55.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1708c0700 1 -- 172.21.15.164:0/3795003985 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1540039a0 msgr2=0x7fb154003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:55.785 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1708c0700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1540039a0 0x7fb154003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:55.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1708c0700 1 -- 172.21.15.164:0/3795003985 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154003280 con 0x7fb154004520 2020-11-20T12:02:55.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1718c2700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb154004e90 0x7fb15400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:55.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1718c2700 1 -- 172.21.15.164:0/3795003985 reap_dead start 2020-11-20T12:02:55.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb1708c0700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb154004520 0x7fb1540049a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fb16000c470 tx=0x7fb16c152040).ready entity=mon.1 client_cookie=a87d003b2b42fc12 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:55.786 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600070d0 con 0x7fb154004520 2020-11-20T12:02:55.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160007230 con 0x7fb154004520 2020-11-20T12:02:55.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.774+0000 7fb15ffff700 1 -- 172.21.15.164:0/3795003985 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160005630 con 0x7fb154004520 2020-11-20T12:02:55.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.775+0000 7fb173325700 1 -- 172.21.15.164:0/3795003985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb154004520 msgr2=0x7fb1540049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:55.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.775+0000 7fb173325700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb154004520 0x7fb1540049a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fb16000c470 tx=0x7fb16c152040).stop 2020-11-20T12:02:55.787 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.775+0000 7fb173325700 1 -- 172.21.15.164:0/3795003985 shutdown_connections 2020-11-20T12:02:55.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.775+0000 7fb173325700 1 --2- 172.21.15.164:0/3795003985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb154004520 0x7fb1540049a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:55.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.775+0000 7fb173325700 1 -- 172.21.15.164:0/3795003985 >> 172.21.15.164:0/3795003985 conn(0x7fb16c0678e0 msgr2=0x7fb16c067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:55.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.775+0000 7fb173325700 1 -- 172.21.15.164:0/3795003985 shutdown_connections 2020-11-20T12:02:55.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.775+0000 7fb173325700 1 -- 172.21.15.164:0/3795003985 wait complete. 2020-11-20T12:02:55.788 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.776+0000 7fb173325700 1 Processor -- start 2020-11-20T12:02:55.789 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.776+0000 7fb173325700 1 -- start start 2020-11-20T12:02:55.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb173325700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb154004520 0x7fb16c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:55.791 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb173325700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb16c14c570 0x7fb16c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:55.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb173325700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb16c160e90 0x7fb16c153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:55.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb173325700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c148580 con 0x7fb154004520 2020-11-20T12:02:55.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb173325700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c146960 con 0x7fb16c14c570 2020-11-20T12:02:55.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb173325700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c146c00 con 0x7fb16c160e90 2020-11-20T12:02:55.792 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb1708c0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb16c14c570 0x7fb16c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:55.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb1708c0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb16c14c570 0x7fb16c153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46592/0 (socket says 172.21.15.164:46592) 2020-11-20T12:02:55.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb1708c0700 1 -- 172.21.15.164:0/3329768067 learned_addr learned my addr 172.21.15.164:0/3329768067 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:55.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb1718c2700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb16c160e90 0x7fb16c153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:55.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.777+0000 7fb1710c1700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb154004520 0x7fb16c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:55.793 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb1708c0700 1 -- 172.21.15.164:0/3329768067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb16c160e90 msgr2=0x7fb16c153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:55.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb1708c0700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb16c160e90 0x7fb16c153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:55.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb1708c0700 1 -- 172.21.15.164:0/3329768067 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb154004520 msgr2=0x7fb16c14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:55.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb1708c0700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb154004520 0x7fb16c14c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:55.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb1708c0700 1 -- 172.21.15.164:0/3329768067 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c146ea0 con 0x7fb16c14c570 2020-11-20T12:02:55.794 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb1710c1700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb154004520 0x7fb16c14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:02:55.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb1718c2700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb16c160e90 0x7fb16c153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:55.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb1708c0700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb16c14c570 0x7fb16c153440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fb1540054c0 tx=0x7fb160013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:55.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb15d7fa700 1 -- 172.21.15.164:0/3329768067 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16001a070 con 0x7fb16c14c570 2020-11-20T12:02:55.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb15d7fa700 1 -- 172.21.15.164:0/3329768067 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160000bc0 con 0x7fb16c14c570 2020-11-20T12:02:55.795 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb15d7fa700 1 -- 172.21.15.164:0/3329768067 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160013450 con 0x7fb16c14c570 2020-11-20T12:02:55.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb173325700 1 -- 172.21.15.164:0/3329768067 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16c147140 con 0x7fb16c14c570 2020-11-20T12:02:55.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.778+0000 7fb173325700 1 -- 172.21.15.164:0/3329768067 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16c1465b0 con 0x7fb16c14c570 2020-11-20T12:02:55.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.779+0000 7fb173325700 1 -- 172.21.15.164:0/3329768067 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16c069b70 con 0x7fb16c14c570 2020-11-20T12:02:55.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.780+0000 7fb15d7fa700 1 -- 172.21.15.164:0/3329768067 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb160026070 con 0x7fb16c14c570 2020-11-20T12:02:55.796 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.780+0000 7fb15d7fa700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb1440806a0 0x7fb144082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:55.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.780+0000 7fb15d7fa700 1 -- 172.21.15.164:0/3329768067 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb1600a35c0 con 0x7fb16c14c570 2020-11-20T12:02:55.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.780+0000 7fb1710c1700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb1440806a0 0x7fb144082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:55.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.780+0000 7fb1710c1700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb1440806a0 0x7fb144082b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb168001200 tx=0x7fb168009040).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:55.797 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.783+0000 7fb15d7fa700 1 -- 172.21.15.164:0/3329768067 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb160077fd0 con 0x7fb16c14c570 2020-11-20T12:02:55.924 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.922+0000 7fb173325700 1 -- 172.21.15.164:0/3329768067 --> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb16c060540 con 0x7fb1440806a0 2020-11-20T12:02:55.930 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.927+0000 7fb15d7fa700 1 -- 172.21.15.164:0/3329768067 <== mgr.4111 v2:172.21.15.164:6800/22952 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151152 (secure 0 0 0) 0x7fb16c060540 con 0x7fb1440806a0 2020-11-20T12:02:55.933 INFO:teuthology.orchestra.run.smithi164.stdout: 2020-11-20T12:02:55.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 -- 172.21.15.164:0/3329768067 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb1440806a0 msgr2=0x7fb144082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:55.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb1440806a0 0x7fb144082b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb168001200 tx=0x7fb168009040).stop 2020-11-20T12:02:55.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 -- 172.21.15.164:0/3329768067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb16c14c570 msgr2=0x7fb16c153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:55.934 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb16c14c570 0x7fb16c153440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fb1540054c0 tx=0x7fb160013000).stop 2020-11-20T12:02:55.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 -- 172.21.15.164:0/3329768067 shutdown_connections 2020-11-20T12:02:55.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7fb1440806a0 0x7fb144082b60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:55.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb16c160e90 0x7fb16c153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:55.935 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb154004520 0x7fb16c14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:55.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 --2- 172.21.15.164:0/3329768067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb16c14c570 0x7fb16c153440 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:55.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 -- 172.21.15.164:0/3329768067 >> 172.21.15.164:0/3329768067 conn(0x7fb16c0678e0 msgr2=0x7fb16c0bdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:55.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 -- 172.21.15.164:0/3329768067 shutdown_connections 2020-11-20T12:02:55.936 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:55.929+0000 7fb173325700 1 -- 172.21.15.164:0/3329768067 wait complete. 2020-11-20T12:02:55.937 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2020-11-20T12:02:55.944 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":392,"stamp":"2020-11-20T12:02:54.312075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384264,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":68039,"num_read_kb":4839627,"num_write":247435,"num_write_kb":25840763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17094,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80646,"ondisk_log_size":80646,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3542536,"kb_used_data":4264,"kb_used_omap":0,"kb_used_meta":3538176,"kb_avail":1128919544,"statfs":{"total":1159641169920,"available":1156013613056,"internally_reserved":0,"allocated":4366336,"data_stored":2400180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3623092224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002993"},"pg_stats":[{"pgid":"4.2","version":"28'28576","reported_seq":"36768","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:39.788303+0000","last_change":"2020-11-20T12:02:39.788392+0000","last_active":"2020-11-20T12:02:39.788303+0000","last_peered":"2020-11-20T12:02:39.788303+0000","last_clean":"2020-11-20T12:02:39.788303+0000","last_became_active":"2020-11-20T11:50:39.389230+0000","last_became_peered":"2020-11-20T11:50:39.389230+0000","last_unstale":"2020-11-20T12:02:39.788303+0000","last_undegraded":"2020-11-20T12:02:39.788303+0000","last_fullsized":"2020-11-20T12:02:39.788303+0000","mapping_epoch":26,"log_start":"28'18500","ondisk_log_start":"28'18500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28576","last_scrub_stamp":"2020-11-20T12:02:39.788297+0000","last_deep_scrub":"28'28576","last_deep_scrub_stamp":"2020-11-20T12:02:39.788297+0000","last_clean_scrub_stamp":"2020-11-20T12:02:39.788297+0000","log_size":10076,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8178,"num_read_kb":581860,"num_write":29951,"num_write_kb":3122376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,0],"acting":[9,10,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:35.626589+0000","last_change":"2020-11-20T12:02:35.626703+0000","last_active":"2020-11-20T12:02:35.626589+0000","last_peered":"2020-11-20T12:02:35.626589+0000","last_clean":"2020-11-20T12:02:35.626589+0000","last_became_active":"2020-11-20T11:50:33.149402+0000","last_became_peered":"2020-11-20T11:50:33.149402+0000","last_unstale":"2020-11-20T12:02:35.626589+0000","last_undegraded":"2020-11-20T12:02:35.626589+0000","last_fullsized":"2020-11-20T12:02:35.626589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:02:35.626580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:02:35.626580+0000","last_clean_scrub_stamp":"2020-11-20T12:02:35.626580+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"28'13","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:36.913786+0000","last_change":"2020-11-20T12:02:36.913864+0000","last_active":"2020-11-20T12:02:36.913786+0000","last_peered":"2020-11-20T12:02:36.913786+0000","last_clean":"2020-11-20T12:02:36.913786+0000","last_became_active":"2020-11-20T11:50:36.273570+0000","last_became_peered":"2020-11-20T11:50:36.273570+0000","last_unstale":"2020-11-20T12:02:36.913786+0000","last_undegraded":"2020-11-20T12:02:36.913786+0000","last_fullsized":"2020-11-20T12:02:36.913786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2020-11-20T12:02:36.913778+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2020-11-20T12:02:36.913778+0000","last_clean_scrub_stamp":"2020-11-20T12:02:36.913778+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"28'30631","reported_seq":"39453","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:42.906142+0000","last_change":"2020-11-20T12:02:42.906229+0000","last_active":"2020-11-20T12:02:42.906142+0000","last_peered":"2020-11-20T12:02:42.906142+0000","last_clean":"2020-11-20T12:02:42.906142+0000","last_became_active":"2020-11-20T11:50:39.279495+0000","last_became_peered":"2020-11-20T11:50:39.279495+0000","last_unstale":"2020-11-20T12:02:42.906142+0000","last_undegraded":"2020-11-20T12:02:42.906142+0000","last_fullsized":"2020-11-20T12:02:42.906142+0000","mapping_epoch":26,"log_start":"28'20602","ondisk_log_start":"28'20602","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'30631","last_scrub_stamp":"2020-11-20T12:02:42.906136+0000","last_deep_scrub":"28'30631","last_deep_scrub_stamp":"2020-11-20T12:02:42.906136+0000","last_clean_scrub_stamp":"2020-11-20T12:02:42.906136+0000","log_size":10029,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8808,"num_read_kb":624576,"num_write":32062,"num_write_kb":3350923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,5,6],"acting":[8,2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:40.339372+0000","last_change":"2020-11-20T12:02:40.339454+0000","last_active":"2020-11-20T12:02:40.339372+0000","last_peered":"2020-11-20T12:02:40.339372+0000","last_clean":"2020-11-20T12:02:40.339372+0000","last_became_active":"2020-11-20T11:50:33.143591+0000","last_became_peered":"2020-11-20T11:50:33.143591+0000","last_unstale":"2020-11-20T12:02:40.339372+0000","last_undegraded":"2020-11-20T12:02:40.339372+0000","last_fullsized":"2020-11-20T12:02:40.339372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:02:40.339368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:02:40.339368+0000","last_clean_scrub_stamp":"2020-11-20T12:02:40.339368+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"28'9","reported_seq":"24","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:35.907012+0000","last_change":"2020-11-20T12:02:35.907078+0000","last_active":"2020-11-20T12:02:35.907012+0000","last_peered":"2020-11-20T12:02:35.907012+0000","last_clean":"2020-11-20T12:02:35.907012+0000","last_became_active":"2020-11-20T11:50:36.455930+0000","last_became_peered":"2020-11-20T11:50:36.455930+0000","last_unstale":"2020-11-20T12:02:35.907012+0000","last_undegraded":"2020-11-20T12:02:35.907012+0000","last_fullsized":"2020-11-20T12:02:35.907012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2020-11-20T12:02:35.907005+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2020-11-20T12:02:35.907005+0000","last_clean_scrub_stamp":"2020-11-20T12:02:35.907005+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"28'26515","reported_seq":"34218","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:46.644226+0000","last_change":"2020-11-20T12:02:46.644310+0000","last_active":"2020-11-20T12:02:46.644226+0000","last_peered":"2020-11-20T12:02:46.644226+0000","last_clean":"2020-11-20T12:02:46.644226+0000","last_became_active":"2020-11-20T11:50:39.278305+0000","last_became_peered":"2020-11-20T11:50:39.278305+0000","last_unstale":"2020-11-20T12:02:46.644226+0000","last_undegraded":"2020-11-20T12:02:46.644226+0000","last_fullsized":"2020-11-20T12:02:46.644226+0000","mapping_epoch":26,"log_start":"28'16500","ondisk_log_start":"28'16500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26515","last_scrub_stamp":"2020-11-20T12:02:46.644220+0000","last_deep_scrub":"28'26515","last_deep_scrub_stamp":"2020-11-20T12:02:46.644220+0000","last_clean_scrub_stamp":"2020-11-20T12:02:46.644220+0000","log_size":10015,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7689,"num_read_kb":545912,"num_write":27745,"num_write_kb":2901671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,8,9],"acting":[2,0,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:38.625734+0000","last_change":"2020-11-20T12:02:38.625833+0000","last_active":"2020-11-20T12:02:38.625734+0000","last_peered":"2020-11-20T12:02:38.625734+0000","last_clean":"2020-11-20T12:02:38.625734+0000","last_became_active":"2020-11-20T11:50:33.149428+0000","last_became_peered":"2020-11-20T11:50:33.149428+0000","last_unstale":"2020-11-20T12:02:38.625734+0000","last_undegraded":"2020-11-20T12:02:38.625734+0000","last_fullsized":"2020-11-20T12:02:38.625734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:02:38.625725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:02:38.625725+0000","last_clean_scrub_stamp":"2020-11-20T12:02:38.625725+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'13","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:41.264193+0000","last_change":"2020-11-20T12:02:41.264276+0000","last_active":"2020-11-20T12:02:41.264193+0000","last_peered":"2020-11-20T12:02:41.264193+0000","last_clean":"2020-11-20T12:02:41.264193+0000","last_became_active":"2020-11-20T11:50:37.249478+0000","last_became_peered":"2020-11-20T11:50:37.249478+0000","last_unstale":"2020-11-20T12:02:41.264193+0000","last_undegraded":"2020-11-20T12:02:41.264193+0000","last_fullsized":"2020-11-20T12:02:41.264193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2020-11-20T12:02:41.264187+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2020-11-20T12:02:41.264187+0000","last_clean_scrub_stamp":"2020-11-20T12:02:41.264187+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"28'29200","reported_seq":"37746","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:41.368027+0000","last_change":"2020-11-20T12:02:41.368108+0000","last_active":"2020-11-20T12:02:41.368027+0000","last_peered":"2020-11-20T12:02:41.368027+0000","last_clean":"2020-11-20T12:02:41.368027+0000","last_became_active":"2020-11-20T11:50:39.315322+0000","last_became_peered":"2020-11-20T11:50:39.315322+0000","last_unstale":"2020-11-20T12:02:41.368027+0000","last_undegraded":"2020-11-20T12:02:41.368027+0000","last_fullsized":"2020-11-20T12:02:41.368027+0000","mapping_epoch":26,"log_start":"28'19100","ondisk_log_start":"28'19100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29200","last_scrub_stamp":"2020-11-20T12:02:41.368023+0000","last_deep_scrub":"28'29200","last_deep_scrub_stamp":"2020-11-20T12:02:41.368023+0000","last_clean_scrub_stamp":"2020-11-20T12:02:41.368023+0000","log_size":10100,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8532,"num_read_kb":608812,"num_write":30604,"num_write_kb":3202634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1,3],"acting":[7,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:38.463508+0000","last_change":"2020-11-20T12:02:38.463601+0000","last_active":"2020-11-20T12:02:38.463508+0000","last_peered":"2020-11-20T12:02:38.463508+0000","last_clean":"2020-11-20T12:02:38.463508+0000","last_became_active":"2020-11-20T11:50:33.452821+0000","last_became_peered":"2020-11-20T11:50:33.452821+0000","last_unstale":"2020-11-20T12:02:38.463508+0000","last_undegraded":"2020-11-20T12:02:38.463508+0000","last_fullsized":"2020-11-20T12:02:38.463508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:02:38.463501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:02:38.463501+0000","last_clean_scrub_stamp":"2020-11-20T12:02:38.463501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"28'6","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:35.433202+0000","last_change":"2020-11-20T12:02:35.433302+0000","last_active":"2020-11-20T12:02:35.433202+0000","last_peered":"2020-11-20T12:02:35.433202+0000","last_clean":"2020-11-20T12:02:35.433202+0000","last_became_active":"2020-11-20T11:50:28.351248+0000","last_became_peered":"2020-11-20T11:50:28.351248+0000","last_unstale":"2020-11-20T12:02:35.433202+0000","last_undegraded":"2020-11-20T12:02:35.433202+0000","last_fullsized":"2020-11-20T12:02:35.433202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2020-11-20T12:02:35.433192+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2020-11-20T12:02:35.433192+0000","last_clean_scrub_stamp":"2020-11-20T12:02:35.433192+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12384,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:41.496971+0000","last_change":"2020-11-20T12:02:41.497064+0000","last_active":"2020-11-20T12:02:41.496971+0000","last_peered":"2020-11-20T12:02:41.496971+0000","last_clean":"2020-11-20T12:02:41.496971+0000","last_became_active":"2020-11-20T11:50:36.274158+0000","last_became_peered":"2020-11-20T11:50:36.274158+0000","last_unstale":"2020-11-20T12:02:41.496971+0000","last_undegraded":"2020-11-20T12:02:41.496971+0000","last_fullsized":"2020-11-20T12:02:41.496971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2020-11-20T12:02:41.496965+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2020-11-20T12:02:41.496965+0000","last_clean_scrub_stamp":"2020-11-20T12:02:41.496965+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"28'31861","reported_seq":"41157","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:40.758940+0000","last_change":"2020-11-20T12:02:40.759033+0000","last_active":"2020-11-20T12:02:40.758940+0000","last_peered":"2020-11-20T12:02:40.758940+0000","last_clean":"2020-11-20T12:02:40.758940+0000","last_became_active":"2020-11-20T11:50:39.389493+0000","last_became_peered":"2020-11-20T11:50:39.389493+0000","last_unstale":"2020-11-20T12:02:40.758940+0000","last_undegraded":"2020-11-20T12:02:40.758940+0000","last_fullsized":"2020-11-20T12:02:40.758940+0000","mapping_epoch":26,"log_start":"28'21800","ondisk_log_start":"28'21800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'31861","last_scrub_stamp":"2020-11-20T12:02:40.758934+0000","last_deep_scrub":"28'31861","last_deep_scrub_stamp":"2020-11-20T12:02:40.758934+0000","last_clean_scrub_stamp":"2020-11-20T12:02:40.758934+0000","log_size":10061,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9282,"num_read_kb":661352,"num_write":33383,"num_write_kb":3474570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2,10],"acting":[9,8,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:39.370331+0000","last_change":"2020-11-20T12:02:39.370430+0000","last_active":"2020-11-20T12:02:39.370331+0000","last_peered":"2020-11-20T12:02:39.370331+0000","last_clean":"2020-11-20T12:02:39.370331+0000","last_became_active":"2020-11-20T11:50:33.144316+0000","last_became_peered":"2020-11-20T11:50:33.144316+0000","last_unstale":"2020-11-20T12:02:39.370331+0000","last_undegraded":"2020-11-20T12:02:39.370331+0000","last_fullsized":"2020-11-20T12:02:39.370331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:02:39.370327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:02:39.370327+0000","last_clean_scrub_stamp":"2020-11-20T12:02:39.370327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'4","reported_seq":"21","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:39.613246+0000","last_change":"2020-11-20T12:02:39.613333+0000","last_active":"2020-11-20T12:02:39.613246+0000","last_peered":"2020-11-20T12:02:39.613246+0000","last_clean":"2020-11-20T12:02:39.613246+0000","last_became_active":"2020-11-20T11:50:36.456244+0000","last_became_peered":"2020-11-20T11:50:36.456244+0000","last_unstale":"2020-11-20T12:02:39.613246+0000","last_undegraded":"2020-11-20T12:02:39.613246+0000","last_fullsized":"2020-11-20T12:02:39.613246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2020-11-20T12:02:39.613239+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2020-11-20T12:02:39.613239+0000","last_clean_scrub_stamp":"2020-11-20T12:02:39.613239+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2121,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":3,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"28'28831","reported_seq":"37238","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:34.654657+0000","last_change":"2020-11-20T12:02:34.654771+0000","last_active":"2020-11-20T12:02:34.654657+0000","last_peered":"2020-11-20T12:02:34.654657+0000","last_clean":"2020-11-20T12:02:34.654657+0000","last_became_active":"2020-11-20T11:50:39.315185+0000","last_became_peered":"2020-11-20T11:50:39.315185+0000","last_unstale":"2020-11-20T12:02:34.654657+0000","last_undegraded":"2020-11-20T12:02:34.654657+0000","last_fullsized":"2020-11-20T12:02:34.654657+0000","mapping_epoch":26,"log_start":"28'18800","ondisk_log_start":"28'18800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28831","last_scrub_stamp":"2020-11-20T12:02:34.654648+0000","last_deep_scrub":"28'28831","last_deep_scrub_stamp":"2020-11-20T12:02:34.654648+0000","last_clean_scrub_stamp":"2020-11-20T12:02:34.654648+0000","log_size":10031,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8393,"num_read_kb":600024,"num_write":30168,"num_write_kb":3162593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,11],"acting":[0,2,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:37.191859+0000","last_change":"2020-11-20T12:02:37.191944+0000","last_active":"2020-11-20T12:02:37.191859+0000","last_peered":"2020-11-20T12:02:37.191859+0000","last_clean":"2020-11-20T12:02:37.191859+0000","last_became_active":"2020-11-20T11:50:33.146090+0000","last_became_peered":"2020-11-20T11:50:33.146090+0000","last_unstale":"2020-11-20T12:02:37.191859+0000","last_undegraded":"2020-11-20T12:02:37.191859+0000","last_fullsized":"2020-11-20T12:02:37.191859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:02:37.191852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:02:37.191852+0000","last_clean_scrub_stamp":"2020-11-20T12:02:37.191852+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'129","reported_seq":"144","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:36.844760+0000","last_change":"2020-11-20T12:02:36.844828+0000","last_active":"2020-11-20T12:02:36.844760+0000","last_peered":"2020-11-20T12:02:36.844760+0000","last_clean":"2020-11-20T12:02:36.844760+0000","last_became_active":"2020-11-20T11:50:36.273653+0000","last_became_peered":"2020-11-20T11:50:36.273653+0000","last_unstale":"2020-11-20T12:02:36.844760+0000","last_undegraded":"2020-11-20T12:02:36.844760+0000","last_fullsized":"2020-11-20T12:02:36.844760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'129","last_scrub_stamp":"2020-11-20T12:02:36.844754+0000","last_deep_scrub":"28'129","last_deep_scrub_stamp":"2020-11-20T12:02:36.844754+0000","last_clean_scrub_stamp":"2020-11-20T12:02:36.844754+0000","log_size":129,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":381374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.0","version":"28'30345","reported_seq":"38996","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:36.792347+0000","last_change":"2020-11-20T12:02:36.792475+0000","last_active":"2020-11-20T12:02:36.792347+0000","last_peered":"2020-11-20T12:02:36.792347+0000","last_clean":"2020-11-20T12:02:36.792347+0000","last_became_active":"2020-11-20T11:50:39.389272+0000","last_became_peered":"2020-11-20T11:50:39.389272+0000","last_unstale":"2020-11-20T12:02:36.792347+0000","last_undegraded":"2020-11-20T12:02:36.792347+0000","last_fullsized":"2020-11-20T12:02:36.792347+0000","mapping_epoch":26,"log_start":"28'20300","ondisk_log_start":"28'20300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'30345","last_scrub_stamp":"2020-11-20T12:02:36.792339+0000","last_deep_scrub":"28'30345","last_deep_scrub_stamp":"2020-11-20T12:02:36.792339+0000","last_clean_scrub_stamp":"2020-11-20T12:02:36.792339+0000","log_size":10045,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8637,"num_read_kb":612900,"num_write":31806,"num_write_kb":3327179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,11,7],"acting":[5,10,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"28'11","reported_seq":"26","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:43.717205+0000","last_change":"2020-11-20T12:02:43.717266+0000","last_active":"2020-11-20T12:02:43.717205+0000","last_peered":"2020-11-20T12:02:43.717205+0000","last_clean":"2020-11-20T12:02:43.717205+0000","last_became_active":"2020-11-20T11:50:37.248661+0000","last_became_peered":"2020-11-20T11:50:37.248661+0000","last_unstale":"2020-11-20T12:02:43.717205+0000","last_undegraded":"2020-11-20T12:02:43.717205+0000","last_fullsized":"2020-11-20T12:02:43.717205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2020-11-20T12:02:43.717200+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2020-11-20T12:02:43.717200+0000","last_clean_scrub_stamp":"2020-11-20T12:02:43.717200+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:35.736609+0000","last_change":"2020-11-20T12:02:35.736692+0000","last_active":"2020-11-20T12:02:35.736609+0000","last_peered":"2020-11-20T12:02:35.736609+0000","last_clean":"2020-11-20T12:02:35.736609+0000","last_became_active":"2020-11-20T11:50:33.395209+0000","last_became_peered":"2020-11-20T11:50:33.395209+0000","last_unstale":"2020-11-20T12:02:35.736609+0000","last_undegraded":"2020-11-20T12:02:35.736609+0000","last_fullsized":"2020-11-20T12:02:35.736609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:02:35.736604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:02:35.736604+0000","last_clean_scrub_stamp":"2020-11-20T12:02:35.736604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1","version":"28'30089","reported_seq":"38621","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:37.633130+0000","last_change":"2020-11-20T12:02:37.633219+0000","last_active":"2020-11-20T12:02:37.633130+0000","last_peered":"2020-11-20T12:02:37.633130+0000","last_clean":"2020-11-20T12:02:37.633130+0000","last_became_active":"2020-11-20T11:50:39.314678+0000","last_became_peered":"2020-11-20T11:50:39.314678+0000","last_unstale":"2020-11-20T12:02:37.633130+0000","last_undegraded":"2020-11-20T12:02:37.633130+0000","last_fullsized":"2020-11-20T12:02:37.633130+0000","mapping_epoch":26,"log_start":"28'20000","ondisk_log_start":"28'20000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'30089","last_scrub_stamp":"2020-11-20T12:02:37.633124+0000","last_deep_scrub":"28'30089","last_deep_scrub_stamp":"2020-11-20T12:02:37.633124+0000","last_clean_scrub_stamp":"2020-11-20T12:02:37.633124+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8518,"num_read_kb":604188,"num_write":31532,"num_write_kb":3298368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,7],"acting":[6,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:42.508957+0000","last_change":"2020-11-20T12:02:42.509036+0000","last_active":"2020-11-20T12:02:42.508957+0000","last_peered":"2020-11-20T12:02:42.508957+0000","last_clean":"2020-11-20T12:02:42.508957+0000","last_became_active":"2020-11-20T11:50:33.395281+0000","last_became_peered":"2020-11-20T11:50:33.395281+0000","last_unstale":"2020-11-20T12:02:42.508957+0000","last_undegraded":"2020-11-20T12:02:42.508957+0000","last_fullsized":"2020-11-20T12:02:42.508957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:02:42.508952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:02:42.508952+0000","last_clean_scrub_stamp":"2020-11-20T12:02:42.508952+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'14","reported_seq":"29","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:02:34.726651+0000","last_change":"2020-11-20T12:02:34.726716+0000","last_active":"2020-11-20T12:02:34.726651+0000","last_peered":"2020-11-20T12:02:34.726651+0000","last_clean":"2020-11-20T12:02:34.726651+0000","last_became_active":"2020-11-20T11:50:36.274438+0000","last_became_peered":"2020-11-20T11:50:36.274438+0000","last_unstale":"2020-11-20T12:02:34.726651+0000","last_undegraded":"2020-11-20T12:02:34.726651+0000","last_fullsized":"2020-11-20T12:02:34.726651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14","last_scrub_stamp":"2020-11-20T12:02:34.726645+0000","last_deep_scrub":"28'14","last_deep_scrub_stamp":"2020-11-20T12:02:34.726645+0000","last_clean_scrub_stamp":"2020-11-20T12:02:34.726645+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11],"acting":[5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68037,"num_read_kb":4839624,"num_write":247251,"num_write_kb":25840314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80446,"ondisk_log_size":80446,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":384264,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":3,"num_write":181,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":768528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12384,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444183,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230124,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":229824,"kb_avail":94141716,"statfs":{"total":96636764160,"available":96401117184,"internally_reserved":0,"allocated":299008,"data_stored":138092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":235339776},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:02:50 2020","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.8759999999999999,"15min":1.9119999999999999},"min":{"1min":0.68700000000000006,"5min":0.57399999999999995,"15min":0.56799999999999995},"max":{"1min":1.4359999999999999,"5min":45.957000000000001,"15min":56.518000000000001},"last":1.093},{"interface":"front","average":{"1min":1.1279999999999999,"5min":2.032,"15min":1.998},"min":{"1min":0.64400000000000002,"5min":0.59199999999999997,"15min":0.56399999999999995},"max":{"1min":2.4449999999999998,"5min":46.25,"15min":57.197000000000003},"last":0.93000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Fri Nov 20 12:02:50 2020","interfaces":[{"interface":"back","average":{"1min":2.9079999999999999,"5min":6.7249999999999996,"15min":3.383},"min":{"1min":0.66800000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":19.712,"5min":44.758000000000003,"15min":44.758000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":3.2530000000000001,"5min":6.343,"15min":3.1989999999999998},"min":{"1min":0.80400000000000005,"5min":0.70799999999999996,"15min":0.624},"max":{"1min":20.456,"5min":44.119,"15min":44.119},"last":0.88400000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:02:50 2020","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.802,"15min":1.6779999999999999},"min":{"1min":0.73099999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.823,"5min":39.085000000000001,"15min":39.085000000000001},"last":1.28},{"interface":"front","average":{"1min":1.2789999999999999,"5min":2.133,"15min":1.9470000000000001},"min":{"1min":0.93000000000000005,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.3450000000000002,"5min":39.098999999999997,"15min":39.098999999999997},"last":1.1839999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:02:50 2020","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":2.4529999999999998,"15min":1.9199999999999999},"min":{"1min":0.79800000000000004,"5min":0.71199999999999997,"15min":0.63400000000000001},"max":{"1min":2.7109999999999999,"5min":64.099000000000004,"15min":64.099000000000004},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.234,"5min":2.2149999999999999,"15min":1.7370000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.58899999999999997},"max":{"1min":2.0489999999999999,"5min":64.334999999999994,"15min":64.334999999999994},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Nov 20 12:02:50 2020","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":2.2709999999999999,"15min":2.093},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.66100000000000003},"max":{"1min":2.4620000000000002,"5min":23.638999999999999,"15min":34.286999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.3999999999999999,"5min":2.6880000000000002,"15min":2.387},"min":{"1min":0.86799999999999999,"5min":0.86499999999999999,"15min":0.80000000000000004},"max":{"1min":2.585,"5min":24.097999999999999,"15min":34.472999999999999},"last":1.198}]},{"osd":6,"last update":"Fri Nov 20 12:02:50 2020","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":2.6480000000000001,"15min":2.5659999999999998},"min":{"1min":0.92100000000000004,"5min":0.621,"15min":0.621},"max":{"1min":5.5949999999999998,"5min":46.186,"15min":58.046999999999997},"last":1.038},{"interface":"front","average":{"1min":1.867,"5min":3.0289999999999999,"15min":2.8450000000000002},"min":{"1min":1.1759999999999999,"5min":1.028,"15min":0.91900000000000004},"max":{"1min":6.9429999999999996,"5min":46.640000000000001,"15min":57.896000000000001},"last":1.2509999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:02:50 2020","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":5.3929999999999998,"15min":3.1920000000000002},"min":{"1min":1.3400000000000001,"5min":1.044,"15min":0.91600000000000004},"max":{"1min":18.853999999999999,"5min":65.272999999999996,"15min":65.272999999999996},"last":1.3400000000000001},{"interface":"front","average":{"1min":2.597,"5min":5.2370000000000001,"15min":3.0459999999999998},"min":{"1min":1.056,"5min":0.871,"15min":0.871},"max":{"1min":19.861999999999998,"5min":64.081000000000003,"15min":64.081000000000003},"last":1.1599999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:02:50 2020","interfaces":[{"interface":"back","average":{"1min":2.702,"5min":6.3630000000000004,"15min":3.6019999999999999},"min":{"1min":1.2709999999999999,"5min":1.1200000000000001,"15min":1.006},"max":{"1min":13.317,"5min":45.953000000000003,"15min":45.953000000000003},"last":1.325},{"interface":"front","average":{"1min":2.6560000000000001,"5min":6.173,"15min":3.4849999999999999},"min":{"1min":1.242,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":12.593999999999999,"5min":46.667000000000002,"15min":46.667000000000002},"last":1.4490000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:02:03 2020","interfaces":[{"interface":"back","average":{"1min":2.246,"5min":3.2730000000000001,"15min":2.6920000000000002},"min":{"1min":1.23,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":8.2929999999999993,"5min":47.347999999999999,"15min":58.792000000000002},"last":1.399},{"interface":"front","average":{"1min":2.4100000000000001,"5min":3.6859999999999999,"15min":2.9729999999999999},"min":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"max":{"1min":8.0649999999999995,"5min":46.463000000000001,"15min":58.162999999999997},"last":1.645}]},{"osd":10,"last update":"Fri Nov 20 12:02:50 2020","interfaces":[{"interface":"back","average":{"1min":2.8969999999999998,"5min":4.2800000000000002,"15min":3.0099999999999998},"min":{"1min":1.409,"5min":1.1699999999999999,"15min":1.1699999999999999},"max":{"1min":19.998999999999999,"5min":65.462000000000003,"15min":65.462000000000003},"last":1.712},{"interface":"front","average":{"1min":2.8780000000000001,"5min":4.2350000000000003,"15min":2.915},"min":{"1min":1.3069999999999999,"5min":1.143,"15min":1.143},"max":{"1min":18.494,"5min":64.566999999999993,"15min":64.566999999999993},"last":1.5189999999999999}]}]},{"osd":10,"up_from":17,"seq":73014444184,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345908,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":345600,"kb_avail":94025932,"statfs":{"total":96636764160,"available":96282554368,"internally_reserved":0,"allocated":307200,"data_stored":136165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":353894400},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":1,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":2.617,"15min":1.762},"min":{"1min":0.72899999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":9.3810000000000002,"5min":36.079999999999998,"15min":36.079999999999998},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.357,"5min":3.2599999999999998,"15min":2.0299999999999998},"min":{"1min":0.67700000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":7.0540000000000003,"5min":37.271999999999998,"15min":37.271999999999998},"last":0.71899999999999997}]},{"osd":2,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":10.028,"15min":4.2859999999999996},"min":{"1min":0.73099999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":9.8040000000000003,"5min":58.145000000000003,"15min":58.145000000000003},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.613,"5min":10.381,"15min":4.6539999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.64600000000000002},"max":{"1min":7.1769999999999996,"5min":58.229999999999997,"15min":58.229999999999997},"last":0.77000000000000002}]},{"osd":3,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":4.3689999999999998,"15min":2.5099999999999998},"min":{"1min":0.91600000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":9.9429999999999996,"5min":37.094000000000001,"15min":37.094000000000001},"last":0.999},{"interface":"front","average":{"1min":1.835,"5min":4.4770000000000003,"15min":2.6659999999999999},"min":{"1min":1.0820000000000001,"5min":0.753,"15min":0.753},"max":{"1min":9.1039999999999992,"5min":35.667000000000002,"15min":35.667000000000002},"last":1.0820000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":4.1269999999999998,"15min":3.351},"min":{"1min":0.89500000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":8.2629999999999999,"5min":37.381,"15min":256.52499999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.841,"5min":4.6959999999999997,"15min":3.5369999999999999},"min":{"1min":0.78500000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":10.207000000000001,"5min":37.222000000000001,"15min":259.17500000000001},"last":1.1180000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":1.829,"5min":5.6079999999999997,"15min":3.1720000000000002},"min":{"1min":0.97599999999999998,"5min":0.79900000000000004,"15min":0.75800000000000001},"max":{"1min":8.3770000000000007,"5min":37.502000000000002,"15min":37.502000000000002},"last":0.97599999999999998},{"interface":"front","average":{"1min":2.101,"5min":5.1310000000000002,"15min":3.0569999999999999},"min":{"1min":1.202,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":10.07,"5min":37.375999999999998,"15min":37.375999999999998},"last":1.202}]},{"osd":6,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":2.0950000000000002,"5min":5.7030000000000003,"15min":3.548},"min":{"1min":1.3300000000000001,"5min":0.93899999999999995,"15min":0.78100000000000003},"max":{"1min":9.2460000000000004,"5min":64.608999999999995,"15min":64.608999999999995},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.948,"5min":5.7859999999999996,"15min":3.5779999999999998},"min":{"1min":1.139,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":8.484,"5min":37.637999999999998,"15min":39.478000000000002},"last":1.139}]},{"osd":7,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":9.5299999999999994,"15min":4.5570000000000004},"min":{"1min":1.0720000000000001,"5min":1.0589999999999999,"15min":1.0069999999999999},"max":{"1min":10.35,"5min":64.647999999999996,"15min":64.647999999999996},"last":1.284},{"interface":"front","average":{"1min":2.0680000000000001,"5min":8.8900000000000006,"15min":4.3470000000000004},"min":{"1min":1.2589999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":7.7859999999999996,"5min":64.965000000000003,"15min":64.965000000000003},"last":1.74}]},{"osd":8,"last update":"Fri Nov 20 12:02:00 2020","interfaces":[{"interface":"back","average":{"1min":14.737,"5min":12.978999999999999,"15min":5.8140000000000001},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":64.879000000000005,"5min":64.879000000000005,"15min":64.879000000000005},"last":1.623},{"interface":"front","average":{"1min":13.103999999999999,"5min":11.922000000000001,"15min":5.383},"min":{"1min":1.0700000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":65.153999999999996,"5min":65.153999999999996,"15min":65.153999999999996},"last":1.0660000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":6.7030000000000003,"5min":7.1740000000000004,"15min":4.2220000000000004},"min":{"1min":1.3959999999999999,"5min":1.109,"15min":1.109},"max":{"1min":75.369,"5min":75.369,"15min":75.369},"last":2.012},{"interface":"front","average":{"1min":2.1019999999999999,"5min":7.0049999999999999,"15min":4.0430000000000001},"min":{"1min":1.224,"5min":1.1020000000000001,"15min":1.079},"max":{"1min":8.657,"5min":40.060000000000002,"15min":44.075000000000003},"last":1.224}]},{"osd":11,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":2.306,"5min":6.2430000000000003,"15min":3.5030000000000001},"min":{"1min":1.3080000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":10.786,"5min":37.585000000000001,"15min":37.585000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":2.4950000000000001,"5min":5.9160000000000004,"15min":3.5819999999999999},"min":{"1min":1.5620000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"max":{"1min":9.7669999999999995,"5min":35.936999999999998,"15min":35.936999999999998},"last":1.8720000000000001}]}]},{"osd":9,"up_from":17,"seq":73014444182,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321000,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":320704,"kb_avail":94050840,"statfs":{"total":96636764160,"available":96308060160,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":328400896},"hb_peers":[0,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":2.1579999999999999,"15min":1.921},"min":{"1min":0.67000000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":6.7720000000000002,"5min":25.289000000000001,"15min":25.289000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":2.069,"5min":3.3639999999999999,"15min":2.6680000000000001},"min":{"1min":0.746,"5min":0.64000000000000001,"15min":0.55100000000000005},"max":{"1min":8.7370000000000001,"5min":47.780000000000001,"15min":60.811999999999998},"last":1.4430000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.8460000000000001,"5min":7.7199999999999998,"15min":4.093},"min":{"1min":0.81699999999999995,"5min":0.67300000000000004,"15min":0.65400000000000003},"max":{"1min":15.641999999999999,"5min":45.261000000000003,"15min":58.615000000000002},"last":0.83799999999999997},{"interface":"front","average":{"1min":2.6139999999999999,"5min":7.1820000000000004,"15min":3.976},"min":{"1min":0.92300000000000004,"5min":0.78900000000000003,"15min":0.68100000000000005},"max":{"1min":7.9820000000000002,"5min":44.813000000000002,"15min":60.926000000000002},"last":0.92300000000000004}]},{"osd":3,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.7649999999999999,"5min":2.427,"15min":2.3039999999999998},"min":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.66200000000000003},"max":{"1min":9.7170000000000005,"5min":20.359000000000002,"15min":58.482999999999997},"last":1.1180000000000001},{"interface":"front","average":{"1min":2.157,"5min":2.5259999999999998,"15min":2.206},"min":{"1min":0.73599999999999999,"5min":0.63700000000000001,"15min":0.61299999999999999},"max":{"1min":16.280000000000001,"5min":18.207999999999998,"15min":58.448999999999998},"last":0.80800000000000005}]},{"osd":4,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.921,"5min":2.157,"15min":2.8100000000000001},"min":{"1min":0.83799999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":7.593,"5min":20.119,"15min":111.11},"last":1.2190000000000001},{"interface":"front","average":{"1min":2.3919999999999999,"5min":2.556,"15min":2.9300000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":15.308,"5min":20.468,"15min":111.654},"last":1.3049999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.95,"5min":2.6200000000000001,"15min":2.4239999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.64000000000000001},"max":{"1min":9.6159999999999997,"5min":18.385000000000002,"15min":58.762999999999998},"last":1.054},{"interface":"front","average":{"1min":2.2629999999999999,"5min":2.7669999999999999,"15min":2.7690000000000001},"min":{"1min":0.96299999999999997,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":8.1359999999999992,"5min":20.399000000000001,"15min":61.164999999999999},"last":1.3620000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:02:03 2020","interfaces":[{"interface":"back","average":{"1min":4.4660000000000002,"5min":3.46,"15min":2.7829999999999999},"min":{"1min":0.98799999999999999,"5min":0.749,"15min":0.749},"max":{"1min":24.835999999999999,"5min":24.835999999999999,"15min":60.853999999999999},"last":1.161},{"interface":"front","average":{"1min":4.5389999999999997,"5min":3.5139999999999998,"15min":3.1139999999999999},"min":{"1min":1.1080000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":25.173999999999999,"5min":25.173999999999999,"15min":61.052999999999997},"last":1.4670000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":3.0110000000000001,"5min":5.5750000000000002,"15min":3.798},"min":{"1min":1.339,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":15.428000000000001,"5min":50.103999999999999,"15min":62.203000000000003},"last":1.548},{"interface":"front","average":{"1min":2.9169999999999998,"5min":5.5449999999999999,"15min":3.6579999999999999},"min":{"1min":1.1379999999999999,"5min":0.93600000000000005,"15min":0.93500000000000005},"max":{"1min":16.161999999999999,"5min":51.006,"15min":63.213999999999999},"last":1.2490000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":3.669,"5min":6.0590000000000002,"15min":3.9860000000000002},"min":{"1min":1.3600000000000001,"5min":1.099,"15min":1.0669999999999999},"max":{"1min":16.547000000000001,"5min":28.248999999999999,"15min":61.280999999999999},"last":1.5700000000000001},{"interface":"front","average":{"1min":3.214,"5min":7.3659999999999997,"15min":4.375},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":15.538,"5min":29.207999999999998,"15min":62.451000000000001},"last":1.6399999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":3.1230000000000002,"5min":4.5469999999999997,"15min":3.4089999999999998},"min":{"1min":1.3919999999999999,"5min":1.087,"15min":0.89300000000000002},"max":{"1min":16.384,"5min":34.356000000000002,"15min":62.869999999999997},"last":1.3919999999999999},{"interface":"front","average":{"1min":2.391,"5min":3.8500000000000001,"15min":3.3820000000000001},"min":{"1min":1.266,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":8.5500000000000007,"5min":24.483000000000001,"15min":61.386000000000003},"last":1.657}]},{"osd":11,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.8239999999999998,"5min":3.2080000000000002,"15min":3.0390000000000001},"min":{"1min":1.3169999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":15.746,"5min":20.959,"15min":62.335000000000001},"last":1.72},{"interface":"front","average":{"1min":2.8679999999999999,"5min":3.1699999999999999,"15min":3.0630000000000002},"min":{"1min":1.3129999999999999,"5min":1.286,"15min":1.085},"max":{"1min":16.651,"5min":18.706,"15min":63.060000000000002},"last":1.4850000000000001}]}]},{"osd":8,"up_from":17,"seq":73014444183,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":332396,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":331712,"kb_avail":94039444,"statfs":{"total":96636764160,"available":96296390656,"internally_reserved":0,"allocated":692224,"data_stored":517505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339673088},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:02:42 2020","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":4.6100000000000003,"15min":2.6349999999999998},"min":{"1min":0.627,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":6.8079999999999998,"5min":39.372999999999998,"15min":39.372999999999998},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.228,"5min":4.79,"15min":2.6989999999999998},"min":{"1min":0.71399999999999997,"5min":0.66900000000000004,"15min":0.58499999999999996},"max":{"1min":4.0350000000000001,"5min":39.444000000000003,"15min":39.444000000000003},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:02:42 2020","interfaces":[{"interface":"back","average":{"1min":3.0209999999999999,"5min":15.183999999999999,"15min":6.1340000000000003},"min":{"1min":0.69499999999999995,"5min":0.64300000000000002,"15min":0.60999999999999999},"max":{"1min":20.634,"5min":59.988999999999997,"15min":59.988999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":3.6190000000000002,"5min":17.088000000000001,"15min":6.7960000000000003},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.61299999999999999},"max":{"1min":43.073,"5min":60.848999999999997,"15min":60.848999999999997},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Nov 20 12:02:42 2020","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":4.5899999999999999,"15min":2.5489999999999999},"min":{"1min":0.68899999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.8650000000000002,"5min":30.893999999999998,"15min":30.893999999999998},"last":1.034},{"interface":"front","average":{"1min":2.093,"5min":6.4029999999999996,"15min":3.3580000000000001},"min":{"1min":1.0429999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":6.9329999999999998,"5min":39.195999999999998,"15min":39.195999999999998},"last":1.1919999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:02:42 2020","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":5.7350000000000003,"15min":3.6019999999999999},"min":{"1min":0.98699999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":5.9299999999999997,"5min":39.761000000000003,"15min":166.27000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":2.7730000000000001,"5min":7.1600000000000001,"15min":4.0789999999999997},"min":{"1min":0.82999999999999996,"5min":0.66000000000000003,"15min":0.65700000000000003},"max":{"1min":20.686,"5min":39.249000000000002,"15min":165.77600000000001},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Nov 20 12:02:42 2020","interfaces":[{"interface":"back","average":{"1min":2.7429999999999999,"5min":8.3870000000000005,"15min":3.988},"min":{"1min":0.74099999999999999,"5min":0.64200000000000002,"15min":0.621},"max":{"1min":21.376999999999999,"5min":38.509999999999998,"15min":38.509999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.3440000000000001,"5min":6.4699999999999998,"15min":3.2789999999999999},"min":{"1min":0.91800000000000004,"5min":0.873,"15min":0.69899999999999995},"max":{"1min":4.2889999999999997,"5min":39.585999999999999,"15min":39.585999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Nov 20 12:02:00 2020","interfaces":[{"interface":"back","average":{"1min":8.7390000000000008,"5min":7.7430000000000003,"15min":3.9510000000000001},"min":{"1min":1.1140000000000001,"5min":0.90500000000000003,"15min":0.73299999999999998},"max":{"1min":31.332999999999998,"5min":39.640999999999998,"15min":39.640999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":10.705,"5min":9.7119999999999997,"15min":4.5739999999999998},"min":{"1min":0.98199999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":31.352,"5min":39.607999999999997,"15min":39.607999999999997},"last":1.095}]},{"osd":7,"last update":"Fri Nov 20 12:02:42 2020","interfaces":[{"interface":"back","average":{"1min":2.9169999999999998,"5min":12.074999999999999,"15min":5.3570000000000002},"min":{"1min":1.0600000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":28.632000000000001,"5min":51.020000000000003,"15min":51.020000000000003},"last":0.90300000000000002},{"interface":"front","average":{"1min":4.7779999999999996,"5min":13.477,"15min":6.0069999999999997},"min":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.216},"max":{"1min":28.608000000000001,"5min":40.451000000000001,"15min":40.451000000000001},"last":1.3839999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:02:42 2020","interfaces":[{"interface":"back","average":{"1min":3.1200000000000001,"5min":12.057,"15min":5.5209999999999999},"min":{"1min":1.1319999999999999,"5min":1.0369999999999999,"15min":0.97199999999999998},"max":{"1min":23.539000000000001,"5min":44.856000000000002,"15min":44.856000000000002},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.891,"5min":8.4120000000000008,"15min":4.266},"min":{"1min":1.1299999999999999,"5min":1.115,"15min":1.115},"max":{"1min":8.1940000000000008,"5min":44.020000000000003,"15min":44.020000000000003},"last":1.2729999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:02:42 2020","interfaces":[{"interface":"back","average":{"1min":3.714,"5min":12.59,"15min":5.7519999999999998},"min":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2290000000000001},"max":{"1min":19.763000000000002,"5min":60.356000000000002,"15min":60.356000000000002},"last":1.462},{"interface":"front","average":{"1min":2.9089999999999998,"5min":13.137,"15min":5.9790000000000001},"min":{"1min":1.119,"5min":1.1020000000000001,"15min":1.0269999999999999},"max":{"1min":20.917000000000002,"5min":61.103999999999999,"15min":61.103999999999999},"last":1.349}]},{"osd":11,"last update":"Fri Nov 20 12:02:42 2020","interfaces":[{"interface":"back","average":{"1min":3.2970000000000002,"5min":8.577,"15min":4.2679999999999998},"min":{"1min":1.202,"5min":1.202,"15min":0.92300000000000004},"max":{"1min":19.734000000000002,"5min":39.838999999999999,"15min":39.838999999999999},"last":1.405},{"interface":"front","average":{"1min":3.7749999999999999,"5min":10.113,"15min":4.9329999999999998},"min":{"1min":1.425,"5min":1.212,"15min":1.125},"max":{"1min":20.023,"5min":60.219999999999999,"15min":60.219999999999999},"last":1.5249999999999999}]}]},{"osd":7,"up_from":17,"seq":73014444184,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":441384,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":441088,"kb_avail":93930456,"statfs":{"total":96636764160,"available":96184786944,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":451674112},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":3.423,"15min":2.1789999999999998},"min":{"1min":0.63600000000000001,"5min":0.629,"15min":0.52600000000000002},"max":{"1min":3.21,"5min":26.654,"15min":31.739000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.999,"5min":4.7190000000000003,"15min":2.726},"min":{"1min":0.70199999999999996,"5min":0.59899999999999998,"15min":0.59299999999999997},"max":{"1min":1.5449999999999999,"5min":48.305,"15min":48.305},"last":0.80300000000000005}]},{"osd":1,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":3.8410000000000002,"15min":2.29},"min":{"1min":0.65000000000000002,"5min":0.64700000000000002,"15min":0.56599999999999995},"max":{"1min":1.5349999999999999,"5min":25.803000000000001,"15min":25.803000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":4.8399999999999999,"15min":2.8690000000000002},"min":{"1min":0.77200000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":5.6520000000000001,"5min":30.164999999999999,"15min":30.164999999999999},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":11.763999999999999,"15min":5.0149999999999997},"min":{"1min":0.79300000000000004,"5min":0.64500000000000002,"15min":0.51100000000000001},"max":{"1min":1.472,"5min":55.094999999999999,"15min":55.094999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.212,"5min":10.683,"15min":4.6349999999999998},"min":{"1min":0.74399999999999999,"5min":0.68799999999999994,"15min":0.55700000000000005},"max":{"1min":3.5619999999999998,"5min":54.805,"15min":54.805},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":5.8289999999999997,"15min":3.1779999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.72499999999999998},"max":{"1min":3.7200000000000002,"5min":50.558,"15min":50.558},"last":1.163},{"interface":"front","average":{"1min":1.246,"5min":5.0519999999999996,"15min":2.8420000000000001},"min":{"1min":1.036,"5min":0.77500000000000002,"15min":0.73299999999999998},"max":{"1min":1.4790000000000001,"5min":47.828000000000003,"15min":47.828000000000003},"last":1.2010000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":5.4660000000000002,"15min":3.335},"min":{"1min":0.86799999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":3.3410000000000002,"5min":48.515000000000001,"15min":57.018000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":5.7199999999999998,"15min":3.4409999999999998},"min":{"1min":0.99199999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":5.1619999999999999,"5min":48.432000000000002,"15min":65.472999999999999},"last":1.2330000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":6.9139999999999997,"15min":3.7959999999999998},"min":{"1min":1.0820000000000001,"5min":1.0389999999999999,"15min":0.82499999999999996},"max":{"1min":1.9299999999999999,"5min":54.665999999999997,"15min":54.665999999999997},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.7,"5min":6.032,"15min":3.6680000000000001},"min":{"1min":1.1950000000000001,"5min":1.175,"15min":0.78600000000000003},"max":{"1min":3.468,"5min":48.649000000000001,"15min":48.649000000000001},"last":1.3520000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.5099999999999998,"5min":10.516,"15min":4.8099999999999996},"min":{"1min":1.107,"5min":0.90600000000000003,"15min":0.85699999999999998},"max":{"1min":18.652000000000001,"5min":60.439999999999998,"15min":60.439999999999998},"last":1.3939999999999999},{"interface":"front","average":{"1min":2.6669999999999998,"5min":11.667,"15min":5.5129999999999999},"min":{"1min":1.2450000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":19.457000000000001,"5min":54.93,"15min":57.436},"last":1.456}]},{"osd":9,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.843,"5min":7.3470000000000004,"15min":4.2249999999999996},"min":{"1min":1.2669999999999999,"5min":1.1559999999999999,"15min":1.1040000000000001},"max":{"1min":18.620999999999999,"5min":34.847000000000001,"15min":34.847000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":2.6840000000000002,"5min":7.3719999999999999,"15min":4.1740000000000004},"min":{"1min":1.3080000000000001,"5min":1.0669999999999999,"15min":0.94899999999999995},"max":{"1min":18.506,"5min":48.563000000000002,"15min":48.563000000000002},"last":1.54}]},{"osd":10,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.8700000000000001,"5min":9.0449999999999999,"15min":4.4939999999999998},"min":{"1min":1.321,"5min":1.26,"15min":0.81200000000000006},"max":{"1min":5.7050000000000001,"5min":51.338999999999999,"15min":51.338999999999999},"last":1.379},{"interface":"front","average":{"1min":2.956,"5min":9.4570000000000007,"15min":4.7270000000000003},"min":{"1min":1.339,"5min":1.3069999999999999,"15min":1.0509999999999999},"max":{"1min":18.77,"5min":83.480999999999995,"15min":83.480999999999995},"last":1.5149999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":7.2439999999999998,"15min":3.972},"min":{"1min":1.2689999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":4.9269999999999996,"5min":56.963000000000001,"15min":56.963000000000001},"last":1.673},{"interface":"front","average":{"1min":2.8820000000000001,"5min":9.4320000000000004,"15min":4.6740000000000004},"min":{"1min":1.3819999999999999,"5min":1.141,"15min":1.141},"max":{"1min":18.579999999999998,"5min":57.441000000000003,"15min":57.441000000000003},"last":1.5669999999999999}]}]},{"osd":6,"up_from":17,"seq":73014444182,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":442480,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":442176,"kb_avail":93929360,"statfs":{"total":96636764160,"available":96183664640,"internally_reserved":0,"allocated":303104,"data_stored":136546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":452788224},"hb_peers":[1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":2.04,"15min":2.0699999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":6.0019999999999998,"5min":9.2400000000000002,"15min":54.784999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.282,"5min":1.5880000000000001,"15min":1.722},"min":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.883,"5min":8.3819999999999997,"15min":55.107999999999997},"last":0.75600000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.427,"5min":6.6669999999999998,"15min":3.52},"min":{"1min":0.72799999999999998,"5min":0.503,"15min":0.503},"max":{"1min":19.035,"5min":52.994999999999997,"15min":52.994999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":2.8319999999999999,"5min":7.8780000000000001,"15min":4.1799999999999997},"min":{"1min":0.745,"5min":0.68600000000000005,"15min":0.68200000000000005},"max":{"1min":19.530999999999999,"5min":54.621000000000002,"15min":54.621000000000002},"last":1.1859999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.544,"5min":2.4239999999999999,"15min":2.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.66500000000000004},"max":{"1min":18.375,"5min":18.375,"15min":18.375},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.9019999999999999,"15min":1.756},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.66400000000000003},"max":{"1min":4.4349999999999996,"5min":8.5739999999999998,"15min":10.124000000000001},"last":1.101}]},{"osd":4,"last update":"Fri Nov 20 12:02:00 2020","interfaces":[{"interface":"back","average":{"1min":2.8570000000000002,"5min":2.4289999999999998,"15min":1.95},"min":{"1min":0.998,"5min":0.83399999999999996,"15min":0.81200000000000006},"max":{"1min":18.498999999999999,"5min":18.498999999999999,"15min":18.498999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":2.1699999999999999,"15min":1.9990000000000001},"min":{"1min":0.752,"5min":0.68600000000000005,"15min":0.68200000000000005},"max":{"1min":2.653,"5min":15.196,"15min":37.557000000000002},"last":1.252}]},{"osd":5,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.6720000000000002,"5min":3.1960000000000002,"15min":2.524},"min":{"1min":0.98399999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":18.646999999999998,"5min":19.068999999999999,"15min":19.068999999999999},"last":1.218},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.8220000000000001,"15min":2.3399999999999999},"min":{"1min":0.95399999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":18.466000000000001,"5min":18.466000000000001,"15min":18.466000000000001},"last":1.075}]},{"osd":7,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.9089999999999998,"5min":5.5839999999999996,"15min":3.8940000000000001},"min":{"1min":1.349,"5min":1.1419999999999999,"15min":1.03},"max":{"1min":18.873000000000001,"5min":25.669,"15min":63.908999999999999},"last":1.349},{"interface":"front","average":{"1min":2.9729999999999999,"5min":5.5049999999999999,"15min":3.3900000000000001},"min":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.01},"max":{"1min":19.120999999999999,"5min":24.888000000000002,"15min":40.161000000000001},"last":1.3169999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":3.0590000000000002,"5min":6.0789999999999997,"15min":3.504},"min":{"1min":1.175,"5min":0.95099999999999996,"15min":0.91500000000000004},"max":{"1min":18.593,"5min":46.223999999999997,"15min":46.223999999999997},"last":1.395},{"interface":"front","average":{"1min":3.278,"5min":7.4480000000000004,"15min":4.4100000000000001},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":0.754},"max":{"1min":20.039999999999999,"5min":46.268000000000001,"15min":46.268000000000001},"last":1.4950000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":3.1070000000000002,"5min":3.6230000000000002,"15min":2.8450000000000002},"min":{"1min":1.2789999999999999,"5min":1.2010000000000001,"15min":1.0640000000000001},"max":{"1min":18.989000000000001,"5min":37.701000000000001,"15min":37.701000000000001},"last":1.5529999999999999},{"interface":"front","average":{"1min":2.9409999999999998,"5min":3.8239999999999998,"15min":3.0579999999999998},"min":{"1min":1.069,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":18.745000000000001,"5min":38.225000000000001,"15min":38.225000000000001},"last":1.671}]},{"osd":10,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":3.1110000000000002,"5min":3.952,"15min":3.3319999999999999},"min":{"1min":1.585,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":18.693999999999999,"5min":54.341000000000001,"15min":54.341000000000001},"last":1.633},{"interface":"front","average":{"1min":3.0630000000000002,"5min":3.5899999999999999,"15min":2.8410000000000002},"min":{"1min":1.419,"5min":1.288,"15min":1.028},"max":{"1min":18.843,"5min":21.213999999999999,"15min":37.408000000000001},"last":1.425}]},{"osd":11,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":3.028,"5min":2.8140000000000001,"15min":2.6280000000000001},"min":{"1min":1.365,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":18.898,"5min":18.898,"15min":18.898},"last":1.5289999999999999},{"interface":"front","average":{"1min":3.1269999999999998,"5min":3.016,"15min":3.0129999999999999},"min":{"1min":1.554,"5min":1.3140000000000001,"15min":1.006},"max":{"1min":18.542000000000002,"5min":18.542000000000002,"15min":18.542000000000002},"last":1.7529999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444184,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217256,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":216960,"kb_avail":94154584,"statfs":{"total":96636764160,"available":96414294016,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":222167040},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:02:52 2020","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.681,"15min":1.641},"min":{"1min":0.79500000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.0190000000000001,"5min":13.398,"15min":13.398},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.8500000000000001,"15min":1.639},"min":{"1min":0.80800000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":3.9900000000000002,"5min":8.8740000000000006,"15min":8.8740000000000006},"last":1.1879999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:02:52 2020","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":5.3940000000000001,"15min":2.8690000000000002},"min":{"1min":0.75800000000000001,"5min":0.68799999999999994,"15min":0.65000000000000002},"max":{"1min":5.2910000000000004,"5min":28.064,"15min":28.064},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.387,"5min":5.7960000000000003,"15min":3.0499999999999998},"min":{"1min":0.68600000000000005,"5min":0.66800000000000004,"15min":0.64900000000000002},"max":{"1min":4.4429999999999996,"5min":28.161000000000001,"15min":28.161000000000001},"last":0.99199999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:02:52 2020","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.4750000000000001,"15min":1.5840000000000001},"min":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":5.0190000000000001,"5min":5.0190000000000001,"15min":8.8119999999999994},"last":1.216},{"interface":"front","average":{"1min":1.482,"5min":1.746,"15min":1.6990000000000001},"min":{"1min":0.74399999999999999,"5min":0.623,"15min":0.623},"max":{"1min":5.2549999999999999,"5min":7.8959999999999999,"15min":12.047000000000001},"last":1.137}]},{"osd":4,"last update":"Fri Nov 20 12:02:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.621,"15min":1.657},"min":{"1min":0.71399999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":4.3449999999999998,"5min":8.2989999999999995,"15min":8.8249999999999993},"last":0.748},{"interface":"front","average":{"1min":1.806,"5min":1.7809999999999999,"15min":1.9339999999999999},"min":{"1min":0.98199999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":5.1479999999999997,"5min":7.6849999999999996,"15min":11.539},"last":1.0329999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:02:52 2020","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.3069999999999999,"15min":2.0379999999999998},"min":{"1min":0.77700000000000002,"5min":0.623,"15min":0.623},"max":{"1min":4.8819999999999997,"5min":19.629999999999999,"15min":19.629999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.7110000000000001,"5min":2.3889999999999998,"15min":2.415},"min":{"1min":1.01,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":5.3730000000000002,"5min":20.350000000000001,"15min":84.078999999999994},"last":1.054}]},{"osd":6,"last update":"Fri Nov 20 12:02:52 2020","interfaces":[{"interface":"back","average":{"1min":2.6349999999999998,"5min":2.3119999999999998,"15min":2.4140000000000001},"min":{"1min":1.075,"5min":0.751,"15min":0.751},"max":{"1min":11.148999999999999,"5min":11.148999999999999,"15min":26.498999999999999},"last":1.117},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.097,"15min":2.1659999999999999},"min":{"1min":1.0409999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":10.554,"5min":11.605,"15min":26.181999999999999},"last":1.3979999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:02:52 2020","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":5.2480000000000002,"15min":3.141},"min":{"1min":1.0900000000000001,"5min":1.0620000000000001,"15min":1.024},"max":{"1min":18.645,"5min":30.716000000000001,"15min":30.716000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":3.5699999999999998,"5min":5.3259999999999996,"15min":3.5609999999999999},"min":{"1min":1.24,"5min":1.131,"15min":1.131},"max":{"1min":29.055,"5min":30.577000000000002,"15min":82.388999999999996},"last":1.2929999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:02:52 2020","interfaces":[{"interface":"back","average":{"1min":2.052,"5min":6.7130000000000001,"15min":3.6909999999999998},"min":{"1min":1.123,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":7.1539999999999999,"5min":40.718000000000004,"15min":40.718000000000004},"last":1.2689999999999999},{"interface":"front","average":{"1min":2.2149999999999999,"5min":5.9029999999999996,"15min":3.4289999999999998},"min":{"1min":1.1799999999999999,"5min":1.163,"15min":1.163},"max":{"1min":6.3049999999999997,"5min":31.696000000000002,"15min":31.696000000000002},"last":1.466}]},{"osd":9,"last update":"Fri Nov 20 12:02:52 2020","interfaces":[{"interface":"back","average":{"1min":2.3530000000000002,"5min":2.7480000000000002,"15min":2.8119999999999998},"min":{"1min":1.2609999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":5.1230000000000002,"5min":15.138,"15min":84.161000000000001},"last":1.6819999999999999},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.4910000000000001,"15min":2.7690000000000001},"min":{"1min":1.3280000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":5.4370000000000003,"5min":14.737,"15min":82.528000000000006},"last":1.363}]},{"osd":11,"last update":"Fri Nov 20 12:02:52 2020","interfaces":[{"interface":"back","average":{"1min":1.891,"5min":2.4279999999999999,"15min":2.4550000000000001},"min":{"1min":1.198,"5min":1.014,"15min":1.014},"max":{"1min":5.4119999999999999,"5min":11.734,"15min":11.734},"last":1.536},{"interface":"front","average":{"1min":2.1400000000000001,"5min":2.4569999999999999,"15min":2.4620000000000002},"min":{"1min":1.3460000000000001,"5min":1.163,"15min":1.163},"max":{"1min":5.2519999999999998,"5min":9.6880000000000006,"15min":9.6880000000000006},"last":1.597}]}]},{"osd":0,"up_from":17,"seq":73014444182,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307112,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":306816,"kb_avail":94064728,"statfs":{"total":96636764160,"available":96322281472,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":314179584},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":3.1859999999999999,"5min":2.6309999999999998,"15min":1.8939999999999999},"min":{"1min":0.71499999999999997,"5min":0.65400000000000003,"15min":0.64800000000000002},"max":{"1min":19.533000000000001,"5min":70.542000000000002,"15min":70.542000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":2.5739999999999998,"5min":2.5099999999999998,"15min":1.804},"min":{"1min":0.63,"5min":0.63,"15min":0.621},"max":{"1min":21.091999999999999,"5min":70.581999999999994,"15min":70.581999999999994},"last":1.175}]},{"osd":2,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":13.818,"5min":6.8499999999999996,"15min":3.4929999999999999},"min":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.57099999999999995},"max":{"1min":38.311999999999998,"5min":56.567,"15min":56.567},"last":0.86599999999999999},{"interface":"front","average":{"1min":13.390000000000001,"5min":7.4059999999999997,"15min":3.714},"min":{"1min":0.879,"5min":0.75600000000000001,"15min":0.59099999999999997},"max":{"1min":39.043999999999997,"5min":54.677,"15min":54.677},"last":1.135}]},{"osd":3,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":4.6280000000000001,"5min":2.5649999999999999,"15min":1.982},"min":{"1min":0.72099999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":21.279,"5min":21.279,"15min":21.279},"last":1.3560000000000001},{"interface":"front","average":{"1min":3.7349999999999999,"5min":2.4119999999999999,"15min":1.905},"min":{"1min":0.876,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":20.106000000000002,"5min":20.106000000000002,"15min":20.106000000000002},"last":1.2789999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":3.645,"5min":3.226,"15min":2.0990000000000002},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":23.719999999999999,"5min":71.278999999999996,"15min":71.278999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":4.6100000000000003,"5min":3.4470000000000001,"15min":2.3999999999999999},"min":{"1min":0.73499999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":22.428000000000001,"5min":70.400000000000006,"15min":70.400000000000006},"last":1.5089999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":5.7919999999999998,"5min":3.875,"15min":2.6600000000000001},"min":{"1min":1.175,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":25.655999999999999,"5min":28.562999999999999,"15min":28.562999999999999},"last":1.3979999999999999},{"interface":"front","average":{"1min":4.8280000000000003,"5min":3.581,"15min":2.4550000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.65900000000000003},"max":{"1min":25.934999999999999,"5min":28.533999999999999,"15min":28.533999999999999},"last":1.3120000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":4.6920000000000002,"5min":3.2040000000000002,"15min":2.589},"min":{"1min":0.94099999999999995,"5min":0.92300000000000004,"15min":0.81299999999999994},"max":{"1min":22.518999999999998,"5min":22.518999999999998,"15min":22.518999999999998},"last":1.659},{"interface":"front","average":{"1min":5.6459999999999999,"5min":3.4660000000000002,"15min":2.6509999999999998},"min":{"1min":1.4550000000000001,"5min":0.94199999999999995,"15min":0.89300000000000002},"max":{"1min":24.466000000000001,"5min":24.466000000000001,"15min":24.466000000000001},"last":1.534}]},{"osd":7,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":7.2160000000000002,"5min":5.7190000000000003,"15min":3.3279999999999998},"min":{"1min":1.137,"5min":1.022,"15min":0.96499999999999997},"max":{"1min":24.622,"5min":72.611000000000004,"15min":72.611000000000004},"last":1.4510000000000001},{"interface":"front","average":{"1min":6.0819999999999999,"5min":5.7199999999999998,"15min":3.4340000000000002},"min":{"1min":1.258,"5min":1.008,"15min":1.008},"max":{"1min":24.332999999999998,"5min":84.977999999999994,"15min":84.977999999999994},"last":1.806}]},{"osd":8,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":12.308999999999999,"5min":7.7140000000000004,"15min":4.0519999999999996},"min":{"1min":1.264,"5min":1.03,"15min":0.89500000000000002},"max":{"1min":26.106999999999999,"5min":28.295999999999999,"15min":28.295999999999999},"last":1.5549999999999999},{"interface":"front","average":{"1min":10.15,"5min":7.1289999999999996,"15min":3.96},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":23.861999999999998,"5min":26.969999999999999,"15min":26.969999999999999},"last":1.9099999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":6.7400000000000002,"5min":3.7450000000000001,"15min":3.0470000000000002},"min":{"1min":1.444,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":29.007999999999999,"5min":29.007999999999999,"15min":29.007999999999999},"last":1.8320000000000001},{"interface":"front","average":{"1min":4.8419999999999996,"5min":3.4529999999999998,"15min":2.8599999999999999},"min":{"1min":1.3500000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":24.728000000000002,"5min":24.728000000000002,"15min":24.728000000000002},"last":1.7250000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:01:51 2020","interfaces":[{"interface":"back","average":{"1min":5.0599999999999996,"5min":3.4039999999999999,"15min":2.778},"min":{"1min":1.341,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":22.533999999999999,"5min":22.533999999999999,"15min":22.533999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":4.6719999999999997,"5min":3.3639999999999999,"15min":2.7109999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":26.276,"5min":26.276,"15min":26.276},"last":1.6459999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444183,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424432,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":424128,"kb_avail":93947408,"statfs":{"total":96636764160,"available":96202145792,"internally_reserved":0,"allocated":303104,"data_stored":136546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":434307072},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:02:47 2020","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":5.9770000000000003,"15min":3.3199999999999998},"min":{"1min":0.66700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":4.3150000000000004,"5min":30.646999999999998,"15min":30.646999999999998},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":5.6369999999999996,"15min":3.2429999999999999},"min":{"1min":0.83799999999999997,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":4.3479999999999999,"5min":41.847000000000001,"15min":41.847000000000001},"last":1.282}]},{"osd":1,"last update":"Fri Nov 20 12:02:47 2020","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":5.0030000000000001,"15min":2.7250000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.55400000000000005},"max":{"1min":4.6390000000000002,"5min":30.812000000000001,"15min":30.812000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.3380000000000001,"5min":5.9729999999999999,"15min":3.077},"min":{"1min":0.61299999999999999,"5min":0.61099999999999999,"15min":0.56299999999999994},"max":{"1min":4.4960000000000004,"5min":41.978999999999999,"15min":41.978999999999999},"last":0.751}]},{"osd":3,"last update":"Fri Nov 20 12:02:47 2020","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":7.0199999999999996,"15min":3.4319999999999999},"min":{"1min":0.84199999999999997,"5min":0.79900000000000004,"15min":0.60199999999999998},"max":{"1min":4.907,"5min":38.066000000000003,"15min":38.066000000000003},"last":1.04},{"interface":"front","average":{"1min":1.4139999999999999,"5min":6.7329999999999997,"15min":3.3490000000000002},"min":{"1min":0.77200000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.6029999999999998,"5min":41.701999999999998,"15min":41.701999999999998},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Nov 20 12:02:47 2020","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":6.9630000000000001,"15min":3.5449999999999999},"min":{"1min":0.82099999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":6.9269999999999996,"5min":37.841000000000001,"15min":37.841000000000001},"last":1.109},{"interface":"front","average":{"1min":2.7930000000000001,"5min":7.476,"15min":3.8839999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":15.234,"5min":42.112000000000002,"15min":42.112000000000002},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:02:47 2020","interfaces":[{"interface":"back","average":{"1min":2.488,"5min":9.7110000000000003,"15min":4.6710000000000003},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.80500000000000005},"max":{"1min":15.651,"5min":52.463000000000001,"15min":52.463000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":2.2429999999999999,"5min":6.2610000000000001,"15min":3.2559999999999998},"min":{"1min":0.83599999999999997,"5min":0.70999999999999996,"15min":0.63600000000000001},"max":{"1min":13.853999999999999,"5min":51.593000000000004,"15min":51.593000000000004},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:02:47 2020","interfaces":[{"interface":"back","average":{"1min":4.149,"5min":11.166,"15min":5.1479999999999997},"min":{"1min":1.026,"5min":1.026,"15min":0.92800000000000005},"max":{"1min":32.713000000000001,"5min":53.091999999999999,"15min":53.091999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":3.9060000000000001,"5min":11.571,"15min":5.2850000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.88400000000000001},"max":{"1min":32.859000000000002,"5min":54.316000000000003,"15min":54.316000000000003},"last":1.139}]},{"osd":8,"last update":"Fri Nov 20 12:02:47 2020","interfaces":[{"interface":"back","average":{"1min":2.4220000000000002,"5min":12.739000000000001,"15min":5.2999999999999998},"min":{"1min":0.72699999999999998,"5min":0.71299999999999997,"15min":0.67100000000000004},"max":{"1min":13.994999999999999,"5min":42.186999999999998,"15min":42.186999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":3.1240000000000001,"5min":16.992999999999999,"15min":7.2599999999999998},"min":{"1min":1.075,"5min":1.075,"15min":1.0229999999999999},"max":{"1min":14.347,"5min":53.581000000000003,"15min":53.581000000000003},"last":1.244}]},{"osd":9,"last update":"Fri Nov 20 12:02:47 2020","interfaces":[{"interface":"back","average":{"1min":2.9950000000000001,"5min":10.077,"15min":5.0199999999999996},"min":{"1min":1.1319999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":15.353,"5min":42.360999999999997,"15min":42.360999999999997},"last":1.216},{"interface":"front","average":{"1min":2.0880000000000001,"5min":7.444,"15min":3.6739999999999999},"min":{"1min":0.97799999999999998,"5min":0.83499999999999996,"15min":0.82199999999999995},"max":{"1min":6.609,"5min":37.781999999999996,"15min":37.781999999999996},"last":1.01}]},{"osd":10,"last update":"Fri Nov 20 12:02:47 2020","interfaces":[{"interface":"back","average":{"1min":3.2069999999999999,"5min":9.8300000000000001,"15min":4.907},"min":{"1min":1.3149999999999999,"5min":1.302,"15min":1.008},"max":{"1min":14.116,"5min":32.781999999999996,"15min":32.781999999999996},"last":1.3100000000000001},{"interface":"front","average":{"1min":2.8210000000000002,"5min":10.045999999999999,"15min":5.0439999999999996},"min":{"1min":1.363,"5min":1.1539999999999999,"15min":0.99099999999999999},"max":{"1min":15.472,"5min":42.966999999999999,"15min":42.966999999999999},"last":1.347}]},{"osd":11,"last update":"Fri Nov 20 12:01:52 2020","interfaces":[{"interface":"back","average":{"1min":5.7999999999999998,"5min":4.9690000000000003,"15min":2.7490000000000001},"min":{"1min":0.95699999999999996,"5min":0.93000000000000005,"15min":0.80400000000000005},"max":{"1min":32.301000000000002,"5min":32.301000000000002,"15min":32.301000000000002},"last":1.125},{"interface":"front","average":{"1min":15.843,"5min":9.5020000000000007,"15min":4.6040000000000001},"min":{"1min":1.286,"5min":1.1890000000000001,"15min":1.081},"max":{"1min":44.747,"5min":44.747,"15min":44.747},"last":1.3759999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444184,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123492,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":122816,"kb_avail":94248348,"statfs":{"total":96636764160,"available":96510308352,"internally_reserved":0,"allocated":684032,"data_stored":517345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":125763584},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":2.3029999999999999,"15min":1.8400000000000001},"min":{"1min":0.75700000000000001,"5min":0.63300000000000001,"15min":0.58799999999999997},"max":{"1min":4.4139999999999997,"5min":22.856000000000002,"15min":22.856000000000002},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.976,"15min":1.766},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":4.4550000000000001,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":7.6079999999999997,"15min":3.7810000000000001},"min":{"1min":0.68400000000000005,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":5.9409999999999998,"5min":47.859999999999999,"15min":47.859999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.431,"5min":7.016,"15min":3.5699999999999998},"min":{"1min":0.78200000000000003,"5min":0.73999999999999999,"15min":0.71699999999999997},"max":{"1min":4.5819999999999999,"5min":51.231999999999999,"15min":51.231999999999999},"last":1.1579999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.0179999999999998,"5min":2.4630000000000001,"15min":1.821},"min":{"1min":0.78900000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":10.333,"5min":47.366999999999997,"15min":47.366999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.552,"5min":2.5619999999999998,"15min":2.0800000000000001},"min":{"1min":1.0409999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":4.5460000000000003,"5min":47.561999999999998,"15min":47.561999999999998},"last":1.2829999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":3.2599999999999998,"15min":2.4620000000000002},"min":{"1min":0.82099999999999995,"5min":0.505,"15min":0.505},"max":{"1min":4.0830000000000002,"5min":48.454999999999998,"15min":48.454999999999998},"last":1.3220000000000001},{"interface":"front","average":{"1min":2.0209999999999999,"5min":3.5310000000000001,"15min":2.4239999999999999},"min":{"1min":0.98799999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":8.9299999999999997,"5min":47.738,"15min":47.738},"last":1.24}]},{"osd":6,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.5899999999999999,"5min":3.2080000000000002,"15min":2.399},"min":{"1min":0.84099999999999997,"5min":0.69799999999999995,"15min":0.64300000000000002},"max":{"1min":13.058999999999999,"5min":51.186,"15min":51.186},"last":1.087},{"interface":"front","average":{"1min":2.7869999999999999,"5min":4.0279999999999996,"15min":2.968},"min":{"1min":1.2310000000000001,"5min":1.1040000000000001,"15min":0.95199999999999996},"max":{"1min":13.423,"5min":48.158999999999999,"15min":48.158999999999999},"last":1.4710000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.4929999999999999,"5min":5.9729999999999999,"15min":3.4780000000000002},"min":{"1min":1.236,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":11.372,"5min":60.584000000000003,"15min":60.584000000000003},"last":1.6639999999999999},{"interface":"front","average":{"1min":2.4119999999999999,"5min":5.8600000000000003,"15min":3.367},"min":{"1min":1.3,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":11.135,"5min":60.103000000000002,"15min":60.103000000000002},"last":1.4359999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.4470000000000001,"5min":8.8510000000000009,"15min":4.5510000000000002},"min":{"1min":1.1890000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":11.247999999999999,"5min":54.895000000000003,"15min":54.895000000000003},"last":1.5209999999999999},{"interface":"front","average":{"1min":2.8119999999999998,"5min":9.3539999999999992,"15min":4.6210000000000004},"min":{"1min":1.2270000000000001,"5min":0.91700000000000004,"15min":0.872},"max":{"1min":10.635999999999999,"5min":55.241,"15min":55.241},"last":1.3600000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":3.5710000000000002,"15min":2.8660000000000001},"min":{"1min":1.351,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":5.3490000000000002,"5min":48.261000000000003,"15min":48.261000000000003},"last":1.577},{"interface":"front","average":{"1min":2.0899999999999999,"5min":3.6269999999999998,"15min":3.0419999999999998},"min":{"1min":1.575,"5min":1.085,"15min":1.085},"max":{"1min":5.657,"5min":50.363999999999997,"15min":50.363999999999997},"last":1.7090000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.3929999999999998,"5min":3.5649999999999999,"15min":2.7349999999999999},"min":{"1min":1.3340000000000001,"5min":1.0389999999999999,"15min":0.97899999999999998},"max":{"1min":10.196,"5min":54.128999999999998,"15min":54.128999999999998},"last":1.546},{"interface":"front","average":{"1min":2.0139999999999998,"5min":4.1420000000000003,"15min":3.0289999999999999},"min":{"1min":1.52,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.7850000000000001,"5min":51.743000000000002,"15min":51.743000000000002},"last":1.75}]},{"osd":11,"last update":"Fri Nov 20 12:02:49 2020","interfaces":[{"interface":"back","average":{"1min":2.5230000000000001,"5min":3.0979999999999999,"15min":2.7450000000000001},"min":{"1min":1.5,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":6.9749999999999996,"5min":48.630000000000003,"15min":48.630000000000003},"last":1.617},{"interface":"front","average":{"1min":2.5289999999999999,"5min":3.0099999999999998,"15min":2.6030000000000002},"min":{"1min":1.4019999999999999,"5min":1.117,"15min":1.073},"max":{"1min":10.057,"5min":48.878,"15min":48.878},"last":1.4550000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444184,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120688,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":120384,"kb_avail":94251152,"statfs":{"total":96636764160,"available":96513179648,"internally_reserved":0,"allocated":303104,"data_stored":138126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":123273216},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":3.1579999999999999,"15min":2.0659999999999998},"min":{"1min":0.69099999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":4.7690000000000001,"5min":102.258,"15min":102.258},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.6259999999999999,"5min":3.3889999999999998,"15min":2.0529999999999999},"min":{"1min":0.65000000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":6.1769999999999996,"5min":102.45,"15min":102.45},"last":1.0589999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.9590000000000001,"15min":1.4770000000000001},"min":{"1min":0.749,"5min":0.60599999999999998,"15min":0.55900000000000005},"max":{"1min":2.4750000000000001,"5min":47.159999999999997,"15min":47.159999999999997},"last":0.749},{"interface":"front","average":{"1min":1.2090000000000001,"5min":2.1469999999999998,"15min":1.681},"min":{"1min":0.70299999999999996,"5min":0.622,"15min":0.57499999999999996},"max":{"1min":2.6360000000000001,"5min":48.533000000000001,"15min":48.533000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6839999999999999,"15min":1.661},"min":{"1min":0.77000000000000002,"5min":0.69199999999999995,"15min":0.60799999999999998},"max":{"1min":7.5579999999999998,"5min":11.018000000000001,"15min":14.170999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.8839999999999999,"15min":1.8759999999999999},"min":{"1min":0.97599999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":3.3290000000000002,"5min":8.2590000000000003,"15min":41.307000000000002},"last":1.1140000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":2.4140000000000001,"15min":2.1120000000000001},"min":{"1min":0.95699999999999996,"5min":0.751,"15min":0.751},"max":{"1min":6.2809999999999997,"5min":13.441000000000001,"15min":19.434999999999999},"last":1.149},{"interface":"front","average":{"1min":2.2080000000000002,"5min":2.3439999999999999,"15min":2.0510000000000002},"min":{"1min":1.0660000000000001,"5min":0.70499999999999996,"15min":0.67900000000000005},"max":{"1min":6.4299999999999997,"5min":17.093,"15min":17.093},"last":1.1839999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":3.5129999999999999,"15min":2.5169999999999999},"min":{"1min":1.1850000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.8799999999999999,"5min":105.96899999999999,"15min":105.96899999999999},"last":1.325},{"interface":"front","average":{"1min":1.833,"5min":3.762,"15min":2.7200000000000002},"min":{"1min":1.1200000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.7949999999999999,"5min":100.04600000000001,"15min":100.04600000000001},"last":1.266}]},{"osd":7,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":6.9180000000000001,"15min":3.927},"min":{"1min":1.2450000000000001,"5min":1.026,"15min":1.0069999999999999},"max":{"1min":3,"5min":161.50700000000001,"15min":161.50700000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":2.6930000000000001,"5min":6.5179999999999998,"15min":3.6560000000000001},"min":{"1min":1.052,"5min":0.94499999999999995,"15min":0.93300000000000005},"max":{"1min":14.577999999999999,"5min":163.98400000000001,"15min":163.98400000000001},"last":1.288}]},{"osd":8,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2250000000000001,"5min":6.2770000000000001,"15min":3.8650000000000002},"min":{"1min":1.2869999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":9.6709999999999994,"5min":62.640000000000001,"15min":69.906999999999996},"last":1.397},{"interface":"front","average":{"1min":2.3690000000000002,"5min":6.7279999999999998,"15min":4.2190000000000003},"min":{"1min":1.304,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":9.6899999999999995,"5min":31.582000000000001,"15min":69.778999999999996},"last":1.419}]},{"osd":9,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":2.0569999999999999,"5min":3.6669999999999998,"15min":2.7080000000000002},"min":{"1min":1.4139999999999999,"5min":1.0009999999999999,"15min":0.94599999999999995},"max":{"1min":5.0170000000000003,"5min":101.361,"15min":101.361},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.952,"5min":3.9390000000000001,"15min":3.0139999999999998},"min":{"1min":1.417,"5min":1.121,"15min":1.121},"max":{"1min":3.4729999999999999,"5min":100.304,"15min":100.304},"last":1.488}]},{"osd":10,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":2.1970000000000001,"5min":3.7810000000000001,"15min":2.8109999999999999},"min":{"1min":1.1830000000000001,"5min":1.022,"15min":1.022},"max":{"1min":6.8689999999999998,"5min":35.225999999999999,"15min":42.716000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":2.2010000000000001,"5min":3.8740000000000001,"15min":2.8460000000000001},"min":{"1min":1.3169999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"max":{"1min":6.0620000000000003,"5min":35.728000000000002,"15min":41.594000000000001},"last":1.524}]},{"osd":11,"last update":"Fri Nov 20 12:02:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2309999999999999,"5min":2.2639999999999998,"15min":2.1669999999999998},"min":{"1min":1.3700000000000001,"5min":1.0149999999999999,"15min":0.999},"max":{"1min":6.7300000000000004,"5min":7.9569999999999999,"15min":18.399999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":2.0920000000000001,"5min":2.4209999999999998,"15min":2.2200000000000002},"min":{"1min":1.46,"5min":1.0980000000000001,"15min":1.056},"max":{"1min":3.9340000000000002,"5min":8.673,"15min":12.753},"last":1.8109999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444184,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236264,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":235968,"kb_avail":94135576,"statfs":{"total":96636764160,"available":96394829824,"internally_reserved":0,"allocated":294912,"data_stored":135971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":241631232},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:02:46 2020","interfaces":[{"interface":"back","average":{"1min":2.6360000000000001,"5min":3.6600000000000001,"15min":2.4510000000000001},"min":{"1min":0.66100000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":27.84,"5min":92.478999999999999,"15min":92.478999999999999},"last":1.371},{"interface":"front","average":{"1min":3.266,"5min":3.9249999999999998,"15min":2.4220000000000002},"min":{"1min":0.80700000000000005,"5min":0.52000000000000002,"15min":0.50900000000000001},"max":{"1min":27.969999999999999,"5min":92.281000000000006,"15min":92.281000000000006},"last":1.1319999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:02:46 2020","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":2.0459999999999998,"15min":1.7110000000000001},"min":{"1min":0.63800000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":4.335,"5min":23.925999999999998,"15min":23.925999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.978,"15min":1.6539999999999999},"min":{"1min":0.71299999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.585,"5min":23.872,"15min":23.872},"last":0.77200000000000002}]},{"osd":2,"last update":"Fri Nov 20 12:02:46 2020","interfaces":[{"interface":"back","average":{"1min":1.7070000000000001,"5min":7.3339999999999996,"15min":3.629},"min":{"1min":0.81899999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":7.1360000000000001,"5min":42.661999999999999,"15min":42.661999999999999},"last":0.753},{"interface":"front","average":{"1min":2.036,"5min":6.3029999999999999,"15min":3.153},"min":{"1min":0.79900000000000004,"5min":0.62,"15min":0.58499999999999996},"max":{"1min":9.9130000000000003,"5min":40.118000000000002,"15min":40.118000000000002},"last":0.90500000000000003}]},{"osd":4,"last update":"Fri Nov 20 12:02:46 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":2.1150000000000002,"15min":1.7549999999999999},"min":{"1min":0.70799999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":6.4930000000000003,"5min":24.416,"15min":24.416},"last":0.97899999999999998},{"interface":"front","average":{"1min":2.036,"5min":2.5779999999999998,"15min":2.1579999999999999},"min":{"1min":0.71599999999999997,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":6.6959999999999997,"5min":25.056999999999999,"15min":25.056999999999999},"last":1.4990000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:02:46 2020","interfaces":[{"interface":"back","average":{"1min":2.4009999999999998,"5min":4.4710000000000001,"15min":2.9430000000000001},"min":{"1min":1.1930000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":9.5370000000000008,"5min":92.433000000000007,"15min":92.433000000000007},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.464,"5min":3.9260000000000002,"15min":2.6600000000000001},"min":{"1min":0.93100000000000005,"5min":0.67900000000000005,"15min":0.63800000000000001},"max":{"1min":5.3869999999999996,"5min":93.030000000000001,"15min":93.030000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:02:46 2020","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":4.3380000000000001,"15min":2.7269999999999999},"min":{"1min":1.0409999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":6.6710000000000003,"5min":28.178999999999998,"15min":28.178999999999998},"last":1.095},{"interface":"front","average":{"1min":1.8700000000000001,"5min":4.7800000000000002,"15min":3.0190000000000001},"min":{"1min":1.075,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":7.1959999999999997,"5min":27.550000000000001,"15min":27.550000000000001},"last":1.2450000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:02:46 2020","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":7.6310000000000002,"15min":3.9220000000000002},"min":{"1min":0.94799999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":9.4160000000000004,"5min":46.585999999999999,"15min":46.585999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":6.5640000000000001,"15min":3.4849999999999999},"min":{"1min":0.91000000000000003,"5min":0.81899999999999995,"15min":0.77700000000000002},"max":{"1min":2.0659999999999998,"5min":32.5,"15min":32.5},"last":1.349}]},{"osd":9,"last update":"Fri Nov 20 12:02:46 2020","interfaces":[{"interface":"back","average":{"1min":2.2189999999999999,"5min":4.4710000000000001,"15min":3.3500000000000001},"min":{"1min":1.2589999999999999,"5min":0.88,"15min":0.88},"max":{"1min":6.8259999999999996,"5min":93.725999999999999,"15min":93.725999999999999},"last":1.581},{"interface":"front","average":{"1min":2.5870000000000002,"5min":4.7359999999999998,"15min":3.379},"min":{"1min":1.4139999999999999,"5min":1.0600000000000001,"15min":0.96399999999999997},"max":{"1min":9.6560000000000006,"5min":93.593000000000004,"15min":93.593000000000004},"last":1.3959999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:02:46 2020","interfaces":[{"interface":"back","average":{"1min":2.036,"5min":3.5670000000000002,"15min":2.7719999999999998},"min":{"1min":1.21,"5min":0.996,"15min":0.996},"max":{"1min":6.9489999999999998,"5min":46.350999999999999,"15min":46.350999999999999},"last":1.6459999999999999},{"interface":"front","average":{"1min":2.359,"5min":3.8820000000000001,"15min":2.7669999999999999},"min":{"1min":1.244,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":9.7780000000000005,"5min":46.466000000000001,"15min":46.466000000000001},"last":1.4650000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:02:46 2020","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":2.9750000000000001,"15min":2.4729999999999999},"min":{"1min":1.357,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":6.5389999999999997,"5min":28.012,"15min":28.012},"last":1.478},{"interface":"front","average":{"1min":2.0899999999999999,"5min":3.2280000000000002,"15min":2.7200000000000002},"min":{"1min":1.496,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":7.0709999999999997,"5min":27.809000000000001,"15min":27.809000000000001},"last":1.7090000000000001}]}]}]}} 2020-11-20T12:02:55.949 INFO:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2020-11-20T12:02:56.060 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.055+0000 7f50ba17b700 1 Processor -- start 2020-11-20T12:02:56.061 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.055+0000 7f50ba17b700 1 -- start start 2020-11-20T12:02:56.061 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50ba17b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f50b40c4470 0x7f50b40c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:56.061 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50ba17b700 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f50b40bccf0 0x7f50b40c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:56.062 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50ba17b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f50b40c10e0 0x7f50b40bf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:56.062 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50ba17b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b41555a0 con 0x7f50b40c10e0 2020-11-20T12:02:56.062 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50ba17b700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b41517d0 con 0x7f50b40c4470 2020-11-20T12:02:56.062 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50ba17b700 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b4151a70 con 0x7f50b40bccf0 2020-11-20T12:02:56.062 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b37fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f50b40c4470 0x7f50b40c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:56.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b37fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f50b40c4470 0x7f50b40c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46596/0 (socket says 172.21.15.164:46596) 2020-11-20T12:02:56.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b37fe700 1 -- 172.21.15.164:0/3822024354 learned_addr learned my addr 172.21.15.164:0/3822024354 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:56.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b2ffd700 1 --2- 172.21.15.164:0/3822024354 >> v2:172.21.15.188:3300/0 conn(0x7f50b40bccf0 0x7f50b40c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:56.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b3fff700 1 --2- 172.21.15.164:0/3822024354 >> v2:172.21.15.36:3300/0 conn(0x7f50b40c10e0 0x7f50b40bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:56.063 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b37fe700 1 -- 172.21.15.164:0/3822024354 >> v2:172.21.15.188:3300/0 conn(0x7f50b40bccf0 msgr2=0x7f50b40c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:56.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b37fe700 1 --2- 172.21.15.164:0/3822024354 >> v2:172.21.15.188:3300/0 conn(0x7f50b40bccf0 0x7f50b40c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b37fe700 1 -- 172.21.15.164:0/3822024354 >> v2:172.21.15.36:3300/0 conn(0x7f50b40c10e0 msgr2=0x7f50b40bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:02:56.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b37fe700 1 --2- 172.21.15.164:0/3822024354 >> v2:172.21.15.36:3300/0 conn(0x7f50b40c10e0 0x7f50b40bf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b37fe700 1 -- 172.21.15.164:0/3822024354 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b4151d10 con 0x7f50b40c4470 2020-11-20T12:02:56.064 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b3fff700 1 --2- 172.21.15.164:0/3822024354 >> v2:172.21.15.36:3300/0 conn(0x7f50b40c10e0 0x7f50b40bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:02:56.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b37fe700 1 --2- 172.21.15.164:0/3822024354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 0x7f50b40c4850 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f50b4081020 tx=0x7f50a8006ef0).ready entity=mon.1 client_cookie=cbbc5182c228b8b1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:56.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b27fc700 1 -- 172.21.15.164:0/3822024354 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800b8c0 con 0x7f50b40c4470 2020-11-20T12:02:56.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b27fc700 1 -- 172.21.15.164:0/3822024354 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a8000e90 con 0x7f50b40c4470 2020-11-20T12:02:56.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.056+0000 7f50b27fc700 1 -- 172.21.15.164:0/3822024354 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800bc30 con 0x7f50b40c4470 2020-11-20T12:02:56.065 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.057+0000 7f50ba17b700 1 -- 172.21.15.164:0/3822024354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 msgr2=0x7f50b40c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:56.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.057+0000 7f50ba17b700 1 --2- 172.21.15.164:0/3822024354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 0x7f50b40c4850 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f50b4081020 tx=0x7f50a8006ef0).stop 2020-11-20T12:02:56.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.057+0000 7f50ba17b700 1 -- 172.21.15.164:0/3822024354 shutdown_connections 2020-11-20T12:02:56.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.057+0000 7f50ba17b700 1 --2- 172.21.15.164:0/3822024354 >> v2:172.21.15.36:3300/0 conn(0x7f50b40c10e0 0x7f50b40bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.066 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.057+0000 7f50ba17b700 1 --2- 172.21.15.164:0/3822024354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 0x7f50b40c4850 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.057+0000 7f50ba17b700 1 --2- 172.21.15.164:0/3822024354 >> v2:172.21.15.188:3300/0 conn(0x7f50b40bccf0 0x7f50b40c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.057+0000 7f50ba17b700 1 -- 172.21.15.164:0/3822024354 >> 172.21.15.164:0/3822024354 conn(0x7f50b40683b0 msgr2=0x7f50b4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:56.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.057+0000 7f50ba17b700 1 -- 172.21.15.164:0/3822024354 shutdown_connections 2020-11-20T12:02:56.067 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.057+0000 7f50ba17b700 1 -- 172.21.15.164:0/3822024354 wait complete. 2020-11-20T12:02:56.069 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.058+0000 7f50ba17b700 1 Processor -- start 2020-11-20T12:02:56.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.058+0000 7f50ba17b700 1 -- start start 2020-11-20T12:02:56.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50ba17b700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b40bccf0 0x7f50b41524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:56.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50ba17b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40c10e0 0x7f50b4161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:56.070 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50ba17b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 0x7f50b4164620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:56.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50ba17b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4164b10 con 0x7f50b40c10e0 2020-11-20T12:02:56.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50ba17b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4153ee0 con 0x7f50b40c4470 2020-11-20T12:02:56.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50ba17b700 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4154180 con 0x7f50b40bccf0 2020-11-20T12:02:56.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50b3fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 0x7f50b4164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:56.071 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50b3fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 0x7f50b4164620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46606/0 (socket says 172.21.15.164:46606) 2020-11-20T12:02:56.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50b3fff700 1 -- 172.21.15.164:0/2449146691 learned_addr learned my addr 172.21.15.164:0/2449146691 (peer_addr_for_me v2:172.21.15.164:0/0) 2020-11-20T12:02:56.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50b37fe700 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b40bccf0 0x7f50b41524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:56.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50b2ffd700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40c10e0 0x7f50b4161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:56.072 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50b3fff700 1 -- 172.21.15.164:0/2449146691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b40bccf0 msgr2=0x7f50b41524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:56.073 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50b3fff700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b40bccf0 0x7f50b41524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.073 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50b3fff700 1 -- 172.21.15.164:0/2449146691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40c10e0 msgr2=0x7f50b4161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:56.073 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50b3fff700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40c10e0 0x7f50b4161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.073 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.059+0000 7f50b3fff700 1 -- 172.21.15.164:0/2449146691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b4154420 con 0x7f50b40c4470 2020-11-20T12:02:56.073 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.060+0000 7f50b3fff700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 0x7f50b4164620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f50ac00ecc0 tx=0x7f50ac008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:56.074 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.060+0000 7f50937fe700 1 -- 172.21.15.164:0/2449146691 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00c790 con 0x7f50b40c4470 2020-11-20T12:02:56.074 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.060+0000 7f50937fe700 1 -- 172.21.15.164:0/2449146691 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac00c8f0 con 0x7f50b40c4470 2020-11-20T12:02:56.074 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.060+0000 7f50937fe700 1 -- 172.21.15.164:0/2449146691 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00cc70 con 0x7f50b40c4470 2020-11-20T12:02:56.074 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.060+0000 7f50ba17b700 1 -- 172.21.15.164:0/2449146691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b4160790 con 0x7f50b40c4470 2020-11-20T12:02:56.074 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.060+0000 7f50ba17b700 1 -- 172.21.15.164:0/2449146691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b4160cd0 con 0x7f50b40c4470 2020-11-20T12:02:56.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.061+0000 7f50917fa700 1 -- 172.21.15.164:0/2449146691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5084004fd0 con 0x7f50b40c4470 2020-11-20T12:02:56.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.061+0000 7f50937fe700 1 -- 172.21.15.164:0/2449146691 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f50ac013640 con 0x7f50b40c4470 2020-11-20T12:02:56.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.062+0000 7f50937fe700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f508c080670 0x7f508c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:02:56.075 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.062+0000 7f50937fe700 1 -- 172.21.15.164:0/2449146691 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f50ac0a2d70 con 0x7f50b40c4470 2020-11-20T12:02:56.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.062+0000 7f50b37fe700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f508c080670 0x7f508c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:02:56.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.062+0000 7f50b37fe700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f508c080670 0x7f508c082b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f50a8006f30 tx=0x7f50a8016000).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:02:56.076 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.065+0000 7f50937fe700 1 -- 172.21.15.164:0/2449146691 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f50ac077720 con 0x7f50b40c4470 2020-11-20T12:02:56.208 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.205+0000 7f50917fa700 1 -- 172.21.15.164:0/2449146691 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"} v 0) v1 -- 0x7f5084003b60 con 0x7f50b40c4470 2020-11-20T12:02:56.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.212+0000 7f50937fe700 1 -- 172.21.15.164:0/2449146691 <== mon.1 v2:172.21.15.164:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f50ac077720 con 0x7f50b40c4470 2020-11-20T12:02:56.215 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.212+0000 7f50937fe700 1 -- 172.21.15.164:0/2449146691 <== mon.1 v2:172.21.15.164:3300/0 8 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}]=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f50ac009550 con 0x7f50b40c4470 2020-11-20T12:02:56.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 -- 172.21.15.164:0/2449146691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f508c080670 msgr2=0x7f508c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:56.217 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f508c080670 0x7f508c082b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f50a8006f30 tx=0x7f50a8016000).stop 2020-11-20T12:02:56.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 -- 172.21.15.164:0/2449146691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 msgr2=0x7f50b4164620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:02:56.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 0x7f50b4164620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f50ac00ecc0 tx=0x7f50ac008040).stop 2020-11-20T12:02:56.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 -- 172.21.15.164:0/2449146691 shutdown_connections 2020-11-20T12:02:56.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.164:6800/22952,v1:172.21.15.164:6801/22952] conn(0x7f508c080670 0x7f508c082b30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.218 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50b40c4470 0x7f50b4164620 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b40bccf0 0x7f50b41524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 --2- 172.21.15.164:0/2449146691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40c10e0 0x7f50b4161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:02:56.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 -- 172.21.15.164:0/2449146691 >> 172.21.15.164:0/2449146691 conn(0x7f50b40683b0 msgr2=0x7f50b40c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:02:56.219 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 -- 172.21.15.164:0/2449146691 shutdown_connections 2020-11-20T12:02:56.220 INFO:teuthology.orchestra.run.smithi164.stderr:2020-11-20T12:02:56.214+0000 7f50917fa700 1 -- 172.21.15.164:0/2449146691 wait complete. 2020-11-20T12:02:56.228 INFO:teuthology.misc:Shutting down mds daemons... 2020-11-20T12:02:56.229 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-11-20T12:02:56.229 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:02:56.236 INFO:tasks.ceph.mds.a:Stopped 2020-11-20T12:02:56.237 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-11-20T12:02:56.237 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:02:57.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2020-11-20T12:03:02.339 INFO:tasks.ceph.mds.b:Stopped 2020-11-20T12:03:02.339 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-11-20T12:03:02.340 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:04.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2020-11-20T12:03:04.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2020-11-20T12:03:08.442 INFO:tasks.ceph.mds.c:Stopped 2020-11-20T12:03:08.442 INFO:teuthology.misc:Shutting down osd daemons... 2020-11-20T12:03:08.443 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-11-20T12:03:08.443 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:08.543 INFO:tasks.ceph.osd.0:Stopped 2020-11-20T12:03:08.543 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-11-20T12:03:08.544 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:08.605 INFO:tasks.ceph.osd.3:Stopped 2020-11-20T12:03:08.605 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2020-11-20T12:03:08.606 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:10.844 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2020-11-20T12:03:10.844 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2020-11-20T12:03:14.708 INFO:tasks.ceph.osd.6:Stopped 2020-11-20T12:03:14.709 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2020-11-20T12:03:14.709 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:17.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 is failed for ~0s 2020-11-20T12:03:17.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2020-11-20T12:03:20.811 INFO:tasks.ceph.osd.9:Stopped 2020-11-20T12:03:20.812 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-11-20T12:03:20.812 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:20.885 INFO:tasks.ceph.osd.1:Stopped 2020-11-20T12:03:20.886 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2020-11-20T12:03:20.887 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:20.949 INFO:tasks.ceph.osd.4:Stopped 2020-11-20T12:03:20.950 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2020-11-20T12:03:20.950 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:23.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2020-11-20T12:03:23.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 has been restored 2020-11-20T12:03:27.052 INFO:tasks.ceph.osd.7:Stopped 2020-11-20T12:03:27.053 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2020-11-20T12:03:27.054 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:27.154 INFO:tasks.ceph.osd.10:Stopped 2020-11-20T12:03:27.154 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-11-20T12:03:27.154 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:29.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2020-11-20T12:03:29.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2020-11-20T12:03:33.256 INFO:tasks.ceph.osd.2:Stopped 2020-11-20T12:03:33.257 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2020-11-20T12:03:33.257 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:33.340 INFO:tasks.ceph.osd.5:Stopped 2020-11-20T12:03:33.340 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2020-11-20T12:03:33.340 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:33.435 INFO:tasks.ceph.osd.8:Stopped 2020-11-20T12:03:33.436 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2020-11-20T12:03:33.436 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:33.507 INFO:tasks.ceph.osd.11:Stopped 2020-11-20T12:03:33.507 INFO:teuthology.misc:Shutting down mgr daemons... 2020-11-20T12:03:33.508 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-11-20T12:03:33.509 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:33.535 INFO:tasks.ceph.mgr.x:Stopped 2020-11-20T12:03:33.536 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-11-20T12:03:33.536 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:33.559 INFO:tasks.ceph.mgr.y:Stopped 2020-11-20T12:03:33.559 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2020-11-20T12:03:33.560 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:33.587 INFO:tasks.ceph.mgr.z:Stopped 2020-11-20T12:03:33.587 INFO:teuthology.misc:Shutting down mon daemons... 2020-11-20T12:03:33.588 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-11-20T12:03:33.588 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:33.600 INFO:tasks.ceph.mon.a:Stopped 2020-11-20T12:03:33.601 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-11-20T12:03:33.601 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:33.614 INFO:tasks.ceph.mon.b:Stopped 2020-11-20T12:03:33.614 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-11-20T12:03:33.615 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:03:33.645 INFO:tasks.ceph.mon.c:Stopped 2020-11-20T12:03:33.646 INFO:tasks.ceph:Checking cluster log for badness... 2020-11-20T12:03:33.646 INFO:teuthology.orchestra.run.smithi164:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2020-11-20T12:03:33.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T12:03:33.710 INFO:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-20T12:03:34.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T12:03:34.083 INFO:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2020-11-20T12:03:34.198 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T12:03:34.198 INFO:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2020-11-20T12:03:34.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2020-11-20T12:03:34.270 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi164.front.sepia.ceph.com 2020-11-20T12:03:34.271 INFO:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2020-11-20T12:03:34.357 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-20T12:03:34.357 INFO:teuthology.orchestra.run.smithi036:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2020-11-20T12:03:35.538 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-20T12:03:35.538 INFO:teuthology.orchestra.run.smithi036:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2020-11-20T12:03:35.700 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-20T12:03:35.701 INFO:teuthology.orchestra.run.smithi036:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2020-11-20T12:03:35.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-20T12:03:35.827 INFO:teuthology.orchestra.run.smithi036:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2020-11-20T12:03:35.997 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T12:03:35.998 INFO:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2020-11-20T12:03:37.264 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T12:03:37.264 INFO:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-20T12:03:37.429 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T12:03:37.430 INFO:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2020-11-20T12:03:37.541 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi188.front.sepia.ceph.com 2020-11-20T12:03:37.542 INFO:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2020-11-20T12:03:37.688 INFO:tasks.ceph:Archiving mon data... 2020-11-20T12:03:37.690 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290/data/mon.a.tgz 2020-11-20T12:03:37.690 INFO:teuthology.orchestra.run.smithi164:> mktemp 2020-11-20T12:03:37.719 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.LHedzguodD 2020-11-20T12:03:37.720 INFO:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.LHedzguodD 2020-11-20T12:03:37.994 INFO:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.LHedzguodD 2020-11-20T12:03:38.125 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.LHedzguodD is 746KB 2020-11-20T12:03:38.228 INFO:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.LHedzguodD 2020-11-20T12:03:38.243 DEBUG:teuthology.misc:Transferring archived files from smithi036:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290/data/mon.b.tgz 2020-11-20T12:03:38.243 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-20T12:03:38.266 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.METe0YOIhT 2020-11-20T12:03:38.267 INFO:teuthology.orchestra.run.smithi036:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.METe0YOIhT 2020-11-20T12:03:38.558 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.METe0YOIhT 2020-11-20T12:03:38.761 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.METe0YOIhT is 717KB 2020-11-20T12:03:38.863 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.METe0YOIhT 2020-11-20T12:03:38.878 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290/data/mon.c.tgz 2020-11-20T12:03:38.878 INFO:teuthology.orchestra.run.smithi188:> mktemp 2020-11-20T12:03:38.908 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.OHfLNmZ4d8 2020-11-20T12:03:38.908 INFO:teuthology.orchestra.run.smithi188:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.OHfLNmZ4d8 2020-11-20T12:03:39.249 INFO:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.OHfLNmZ4d8 2020-11-20T12:03:39.427 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.OHfLNmZ4d8 is 746KB 2020-11-20T12:03:39.526 INFO:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.OHfLNmZ4d8 2020-11-20T12:03:39.541 INFO:tasks.ceph:Cleaning ceph cluster... 2020-11-20T12:03:39.542 INFO:teuthology.orchestra.run.smithi036:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:03:39.545 INFO:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:03:39.548 INFO:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:03:39.674 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2020-11-20T12:03:39.674 INFO:teuthology.orchestra.run.smithi164:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:03:39.677 INFO:teuthology.orchestra.run.smithi036:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:03:39.679 INFO:teuthology.orchestra.run.smithi188:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:03:39.703 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:03:39.704 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:03:39.722 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:03:39.783 INFO:tasks.ceph:Archiving crash dumps... 2020-11-20T12:03:39.785 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290/remote/smithi164/crash 2020-11-20T12:03:39.787 INFO:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:03:39.818 DEBUG:teuthology.misc:Transferring archived files from smithi036:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290/remote/smithi036/crash 2020-11-20T12:03:39.819 INFO:teuthology.orchestra.run.smithi036:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:03:39.847 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290/remote/smithi188/crash 2020-11-20T12:03:39.849 INFO:teuthology.orchestra.run.smithi188:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:03:39.875 INFO:tasks.ceph:Shutting down logrotate 2020-11-20T12:05:42.427 INFO:teuthology.orchestra.run.smithi036:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:05:42.488 INFO:teuthology.orchestra.run.smithi164:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:05:42.536 INFO:teuthology.orchestra.run.smithi188:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:05:42.576 INFO:tasks.ceph:Compressing logs... 2020-11-20T12:05:42.576 INFO:teuthology.orchestra.run.smithi036:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:05:42.579 INFO:teuthology.orchestra.run.smithi164:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:05:42.583 INFO:teuthology.orchestra.run.smithi188:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:05:42.619 INFO:tasks.ceph:Archiving logs... 2020-11-20T12:05:42.619 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640290/remote/smithi164/log 2020-11-20T12:05:42.621 INFO:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/log/ceph -- . 2020-11-20T12:13:41.618 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-osd.6.log: file changed as we read it 2020-11-20T12:13:44.689 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.30643.log: File removed before we read it 2020-11-20T12:13:44.690 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.26815.log: File removed before we read it 2020-11-20T12:13:44.690 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27151.log: File removed before we read it 2020-11-20T12:13:44.690 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.26857.log: File removed before we read it 2020-11-20T12:13:44.691 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.30218.log: File removed before we read it 2020-11-20T12:13:44.691 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.31197.log: File removed before we read it 2020-11-20T12:13:44.691 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.30811.log: File removed before we read it 2020-11-20T12:13:44.691 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.30559.log: File removed before we read it 2020-11-20T12:13:44.692 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.28513.log: File removed before we read it 2020-11-20T12:13:44.692 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.31409.log: File removed before we read it 2020-11-20T12:13:44.692 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.25848.log: File removed before we read it 2020-11-20T12:13:44.693 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-mds.a.log: File removed before we read it 2020-11-20T12:13:44.693 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph.tmp-client.admin.18401.log: File removed before we read it 2020-11-20T12:13:44.693 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27739.log: File removed before we read it 2020-11-20T12:13:44.693 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-mgr.x.log: File removed before we read it 2020-11-20T12:13:44.694 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.30601.log: File removed before we read it 2020-11-20T12:13:44.694 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27823.log: File removed before we read it 2020-11-20T12:13:44.694 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27445.log: File removed before we read it 2020-11-20T12:13:44.694 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27025.log: File removed before we read it 2020-11-20T12:13:44.695 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27781.log: File removed before we read it 2020-11-20T12:13:44.695 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.26227.log: File removed before we read it 2020-11-20T12:13:44.695 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.31113.log: File removed before we read it 2020-11-20T12:13:44.695 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27193.log: File removed before we read it 2020-11-20T12:13:44.696 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27949.log: File removed before we read it 2020-11-20T12:13:44.696 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.31281.log: File removed before we read it 2020-11-20T12:13:44.696 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.26311.log: File removed before we read it 2020-11-20T12:13:44.696 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27403.log: File removed before we read it 2020-11-20T12:13:44.697 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.30937.log: File removed before we read it 2020-11-20T12:13:44.697 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27613.log: File removed before we read it 2020-11-20T12:13:44.697 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27697.log: File removed before we read it 2020-11-20T12:13:44.697 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.25685.log: File removed before we read it 2020-11-20T12:13:44.698 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.25581.log: File removed before we read it 2020-11-20T12:13:44.698 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.26017.log: File removed before we read it 2020-11-20T12:13:44.698 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.26605.log: File removed before we read it 2020-11-20T12:13:44.698 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.31155.log: File removed before we read it 2020-11-20T12:13:44.699 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.26983.log: File removed before we read it 2020-11-20T12:13:44.699 INFO:teuthology.orchestra.run.smithi164.stderr:tar: ./ceph-client.admin.27235.log: File removed before we read it